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Preface 


This  research  project  began  by  asking  the  question  "Is  there  a  role  for  scientists  in 
K-12  educational  reform  efforfs?"^  Judging  by  fhe  invesfmenf  fhaf  federal 
funding  agencies  have  made  foward  programs  designed  fo  utilize  fhe  experfise 
of  scienfisfs  in  K-12  reform,  if  would  seem  fhaf  many  feel  fhaf  fhere  is  indeed  a 
role  for  fhose  frained  in  science  in  K-12  education.  Highly  compefenf,  skilled 
scienfisfs  are  a  rich  resource  in  our  sociefy  fhaf  may  be  useful  in  sfrengfhening 
science  and  mafhemafics  educafion  in  schools  across  fhe  counfry.  If  seems, 
appropriafe,  fherefore  fo  confinue  fo  develop  effective  ways  of  merging 
scienfisfs,  as  resources,  info  our  educational  sysfem. 

The  National  Science  Foundafion  (NSF)  has  funded  several  initiatives  designed 
fo  creafe  parfnerships  befween  scienfisfs  and  K-12  classrooms.  These 
parfnerships  involve  scienfisfs  af  various  sfages  of  fheir  careers,  ranging  from 
senior,  retired  scienfisf  fo  scienfisfs  in  fraining.  Because  of  NSF's  inferesf  in 
developing  programs  specifically  designed  fo  parfner  science  graduafe  sfudenfs 
wifh  K-12  classrooms,  NSF  asked  RAND's  Science  and  Technology  Policy 
Insfifufe  fo  sfudy  fhe  range  of  currenf  programs  fhaf  connect  science  graduate 
and  undergraduate  students  to  K-12  classrooms. 

This  report  presents  the  results  of  fhaf  sfudy.  The  goal  of  fhis  research  was  fo 
idenfify  fhe  impacfs,  challenges,  and  sfrafegies  of  programs  fhaf  link  science 
graduafe  and  undergraduafe  sfudenfs  fo  K-12  classrooms.  Information  for  fhis 
sfudy  was  gafhered  from  inferviews  during  sife  visifs  fo  eighf  oufreach 
programs.  Many  of  fhe  challenges  fhese  programs  faced  were  nof  limifed  fo  fhe 
K-12  classrooms  buf  were  relafed  fo  fhe  broader  issue  of  creafing  universify- 
school  parfnerships  as  a  sfrafegy  for  science  educafion  reform. 

This  reporf  should  inferesf  fhose  in  universify  communifies  involved  in 
implemenfing  or  parficipafing  in  oufreach  programs.  If  should  also  be  of  inferesf 
fo  federal  policymakers  who  are  concerned  wifh  science  educafion  reform  and 
fhe  developmenf  of  partnerships  between  universities  and  K-12  schools  as  a 
method  of  improving  science  learning  in  classrooms  across  fhe  counfry. 


^In  this  instance,  we  use  the  word  scientist  to  broadly  refer  both  to  those  trained  in  scientific 
disciplines  and  to  those  who  are  in  training  for  scientific  careers. 
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Summary 


Background 

Not  since  the  Sputnik  "crisis"  has  so  much  public  attention  focused  on 
improving  science  education.  In  the  1950s,  concerns  were  driven  by  national 
security  fears  and  focused  on  increasing  fhe  numbers  of  scienfisfs  able  fo  keep 
fhe  Unifed  Sfafes  ahead  of  fhe  Soviefs  during  fhe  "space  race."  The  currenf 
reform  impulse  springs  from  fhe  awareness  fhaf  U.S.  sociefy  has  become 
increasingly  based  on  science  and  fechnology  and  requires  a  science-liferafe 
workforce  fhaf  is  able  fo  undersfand  and  derive  benefifs  from  recenf  scientific 
advances.  In  confrasf  fo  fhe  earlier  movemenf,  which  focused  on  increasing  fhe 
number  of  scienfisfs,  fhis  movemenf  emphasizes  science  for  all  and  promofes 
changes  in  science  education  fhaf  will  ensure  fhaf  all  sfudenfs  have  equal  access 
and  opporfunifies  fo  learn. 

To  promofe  education  reforms,  a  number  of  inifiafives  have  been  developed  fo 
encourage  changes  in  feaching  practices  fhaf  will  ulfimafely  improve  sfudenf 
learning  in  science.  Some  of  fhese  inifiafives  include  Science  for  All  Americans 
(American  Associafion  for  fhe  Advancement  of  Science),  Projecf  206Ts 
Benchmarks  for  Science  Literacy  (American  Associafion  for  fhe  Advancemenf  of 
Science),  and  fhe  National  Science  Education  Standards  (NSES).  The  NSES, 
released  by  fhe  National  Research  Council  in  1996,  is  one  of  fhe  more  prominenf 
sefs  of  guidelines  among  fhese  inifiafives.  Known  simply  as  fhe  Sfandards,  fhe 
National  Science  Educafion  Sfandards  encourage  an  inquiry -based  approach  fo 
feaching  science  fhaf  enables  sfudenfs  fo  explore  learning  on  fheir  own  and 
encourages  feachers  fo  facilifafe  fhis  process  rafher  fhan  confrol  if. 

For  some  K-12  classrooms,  fhis  new  mefhod  of  feaching  science  has  creafed 
challenges.  One  consequence  of  many  of  fhe  Sfandards'  recommendafions  is  a 
need  for  increased  classroom  time  for  science  insfrucfion  because  fhe  use  of  kifs 
and  ofher  supplemenfal  maferial  requires  addifional  sefup  and  cleanup  time. 
Moreover,  currenf  reforms  emphasize  covering  fewer  fopics  in  greafer  depfh 
fhan  a  fradifional  fexfbook-based  curriculum  and  require  feachers  fo  address 
sfudenfs'  scienfific  fhinking  more  direcfly.  Finally,  feachers  are  challenged  fo 
develop  sophisficafed  classroom  managerial  skills  fo  gef  multiple  (perhaps  as 
many  as  eighf)  groups  of  sfudenfs  fo  remain  simulfaneously  "on  fask"  wifh  fheir 
science  lesson. 


As  a  consequence  of  these  challenges,  mechanisms  to  support  K-12  classrooms  in 
their  efforts  to  implement  these  new  teaching  practices  are  different  and  more 
demanding  than  those  needed  to  support  more-traditional  practices  in  the 
classroom.  In  many  instances,  these  reforms  create  extra  requirements,  such  as 
content  experts  and  curriculum  specialists  to  ensure  that,  through  inquiry-based 
learning,  students  are  guided  to  a  deeper  and  richer  understanding  of  science. 
Often,  another  set  of  hands  is  necessary  to  help  with  all  the  different  group 
activities  that  are  going  on  in  the  classrooms. 

To  support  the  recent  changes  in  K-12  instruction,  many  schools  are  involved  in 
outreach  programs  that  partner  them  with  local  universities.  Partnerships  with 
universities  can  support  teaching  instruction  in  a  number  of  ways.  Universities 
can  provide  instructional  materials  and  resources  to  teachers  to  aid  in  science 
instruction;  facilities,  such  as  laboratories,  to  give  students  and  teachers 
opportunities  to  experience  hands-on  science;  and  human  capital  in  the  form  of 
university  scientists  who  can  work  with  teachers  and  K-12  students  in  a  variety 
of  ways.  Science  graduate  and  undergraduate  students  are  another  important 
university  resource,  and  many  outreach  programs  have  found  ways  to  utilize  the 
talents  and  skills  of  these  students.  These  science  students  may  prove  to  be  an 
invaluable  resource  in  supporting  K-12  classrooms  in  improving  science 
education.  Indicative  of  this  trend,  the  NSF  has  expanded  efforts  to  use  science 
graduate  students  in  outreach  programs  by  creating  the  Graduate  Teaching 
Fellows  in  K-12  (GK-12)  program.  This  program  provides  fellowships  for  science 
graduate  students  (and  some  advanced  undergraduates)  to  serve  as  resources  to 
support  teachers  in  science  and  math  instruction  in  K-12  classrooms.  Very  little  is 
known  about  these  outreach  programs  and  the  effects  they  have  on  K-12 
classrooms  or  on  the  science  students  that  participate  in  the  programs.  As  these 
programs  proliferate,  understanding  their  impacts  and  identifying  the  features  of 
successful  programs  are  crucial  for  informing  the  policy  decisions  about  how 
best  to  help  K-12  classrooms  improve  science  learning. 

This  research  study  examines  the  utilization  of  science  graduate  and 
undergraduate  students  in  K-12  educational  reform  efforts  and  specifically 
addresses  three  main  questions: 

1.  What  are  the  impacts  and  challenges  of  outreach  programs  for  different 
participants  in  K-12  schools? 

2.  What  are  the  impacts  and  challenges  of  outreach  programs  for  different 
participants  in  institutions  of  higher  education? 

3.  What  are  some  of  the  features  of  programs  that  effectively  address  these 
challenges? 


Using  a  case-study  methodology,  the  RAND  research  team  obtained  information 
for  fhis  sfudy  from  sife  visifs  fo  eight  outreach  programs  across  the  country 
Although  all  the  programs  had  similar  goals — enhancing  K-12  science  education 
through  partnerships  with  universities — the  approaches  differed.  The  majorify  of 
fhe  programs  we  visifed  were  direcf  classroom  enhancemenf  programs  in  which 
science  graduafe  and  undergraduafe  sfudenfs  worked  in  fhe  classroom  wifh 
feachers  fo  supporf  learning.  However,  we  also  visifed  programs  fhaf  placed 
feachers  in  fhe  laborafories  wifh  graduafe  sfudenfs,  programs  in  which  science 
graduafe  and  undergraduafe  sfudenfs  developed  and  mainfained  insfrucfional 
maferials  for  K-12  classrooms,  and  programs  fhaf  ufilized  fhe  science  confenf 
knowledge  of  graduafe  and  undergraduafe  sfudenfs  via  fhe  Infernef. 

This  reporf  presenfs  fhe  findings  from  our  research  sfudy.  Based  on  inferviews 
wifh  K-12  feachers,  universify  sfudenfs,  program  adminisfrafors,  and  universify 
faculfy  involved  wifh  fhese  programs,  fhis  reporf  presenfs  fheir  views  on  fhe 
major  impacfs  and  challenges  of  fhese  programs.  This  reporf  also  affempfs  fo 
synfhesize  much  of  fhe  information  fhaf  was  gafhered  and  idenfify  issues  for 
fufure  research  on  fhese  programs. 

Impacts  of  Outreach  Programs 

On  K-12  Teachers  and  Students 

Mosf  of  fhe  oufreach  programs  we  selecfed  for  sife  visifs  focused  fheir  oufreach 
acfivifies  on  schools  in  underserved,  urban  communifies.  Schools  in  fhese 
communities  offen  required  more  resources  fo  implemenf  many  of  fhe 
recommendafions  for  science  education  reform.  As  many  sfudies  have  shown, 
urban  schools  fypically  have  fewer  feachers  wifh  backgrounds  in  science  or 
mafh;  classrooms  are  offen  overcrowded;  and  fhe  feachers  in  fhese  schools  offen 
face  classrooms  of  sfudenfs  having  a  wide  range  of  learning  abilifies.  Under  fhese 
condifions,  feaching  science  can  be  difficulf  nof  only  because  of  fhe  subjecf- 
maffer  experfise  buf  also  because  of  fhe  larger  sociefal  condifions  fhaf  prevail  in 
fhese  schools.  Thus,  if  was  nof  surprising  fhaf  many  of  fhese  programs  had 
impacfs  nof  only  on  fhe  improvemenf  of  fhe  science  contenf  knowledge  of 
feachers  and  sfudenfs  but  also  on  the  "spirit"  of  feaching  science.  Inferviews  wifh 
K-12  feachers  revealed  fhaf  some  of  fhe  mosf  significanf  effecfs  of  fhe  programs 
were  fhe  affifudinal  changes,  as  well  as  fhe  changes  in  feaching  pracfices. 
Teachers  reporfed  spending  more  time  feaching  science,  being  more  comforfable 

^To  ensure  confidentiality  of  the  interviewees,  the  names  of  the  outreach  programs  and  the 
affiliated  universities  are  not  included  in  this  report. 
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teaching  science,  and  feeling  better  serving  as  facilitators,  rather  than  dictators,  of 
science  learning.  Moreover,  many  of  the  K-12  teachers  reported  an  increased 
sense  of  collegiality  toward  other  science  teachers,  which  contributed  to  a  sense 
of  professionalism.  Teachers  stated  that  participating  in  an  outreach  program 
together  created  a  common  bond  that  provided  the  basis  for  more  dialogue, 
interaction,  and  discussion  of  different  methods  of  teaching  science.  We  did  not 
interview  K-12  students,  but  teachers  reported  that  their  students  displayed 
greater  enthusiasm  toward  science  and  that  students  who  had  often  been 
disinterested  or  difficult  to  engage  were  now  active  participants  in  classroom 
activities.  For  programs  that  brought  science  students  into  the  classrooms  to 
work  with  the  teachers,  many  teachers  reported  that  the  relationship  between  the 
K-12  students  and  the  university  students  was  a  key  ingredient  for  motivating 
and  engaging  the  students  in  their  science  lessons. 

Interviews  with  participants  across  the  different  programs  indicated  that  the 
primary  contribution  of  the  science  students  was  their  ability  to  expedite  many  of 
the  reforms  that  were  currently  taking  place.  Most  of  the  programs  were  infusing 
schools  with  resources  toward  the  goal  of  enhancing  science  learning.  However, 
the  university  science  students  acted  as  true  catalysts  by  creating  optimal 
conditions  for  these  changes  to  occur  and  thereby  speeding  up  a  process  that 
might  still  have  occurred  eventually  but  perhaps  have  taken  longer.  Time  is  a 
serious  issue,  particularly  for  students  in  urban  schools.  For  each  year  of 
incremental  progress  toward  changing  teacher  attitude  and  gradually  changing 
teacher  practices,  a  generation  of  students  may  be  losing  opportunities  to 
develop  the  solid  foundation  in  math  and  science  necessary  to  contribute  to  a 
society  increasingly  steeped  in  science  and  technology.  Thus,  even  as  the 
outreach  programs  were  taking  steps  toward  building  better  practices  in  science, 
the  university  science  students  could  expedite  this  process  by  providing  the 
science  content  expertise  and  the  support  teachers  needed  to  achieve  more- 
immediate  changes  in  the  classroom. 


On  University  Science  Students  and  Conununity  Relations 

The  outreach  programs  also  had  a  number  of  impacts  on  the  universities  that 
sponsored  them.  Science  graduate  and  undergraduate  students  reported  that 
participation  in  these  programs  provided  them  with  a  more  in-depth  learning 
and  understanding  of  science.  Although  many  of  the  graduate  students  had 
worked  as  teaching  assistants,  many  found  that  having  to  teach  and  explain 
scientific  concepts  to  a  broader  audience  forced  them  to  think  more  deeply  about 
their  own  understanding  of  science.  Furthermore,  many  science  students  felt 
their  communication  skills  had  also  improved  as  a  result  of  interacting  with  K-12 
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teachers  and  students.  Students  working  with  teachers  in  K-12  classrooms 
reported  that  the  experience  of  doing  outreach  in  urban  schools  made  them 
much  more  aware  of  fhe  imporfance  of  educafional  resources  and  fheir  impacf  on 
learning.  These  sfudenfs  were  acufely  aware  of  fhe  difficulfies  feachers  face: 
classrooms  in  which  fhe  mofivafion  fo  learn  is  low  and  classroom  managemenf 
fakes  precedence  over  learning,  as  well  as  fhe  challenge  of  feaching  science  fo 
sfudenfs  who  have  difficulfy  reading  af  grade  level. 

We  nofed  fhaf  fhese  programs  were  affracfive  fo  science  sfudenfs  for  a  variefy  of 
reasons,  buf  primarily  because  of  fhe  opporfunify  fo  use  fheir  scienfific 
knowledge  fo  help  ofhers.  Despife  fhe  facf  fhaf  mosf  of  fhe  programs  offered 
monefary  compensafion,  few  of  fhe  graduafe  sfudenfs  parficipafed  in  fhese 
programs  solely  for  fhe  money.  The  graduafe  sfudenfs  we  spoke  wifh  wanfed  a 
broader  experience  and  felf  fhaf  fheir  parficipafion  in  oufreach  fo  K-12  sfudenfs 
and  feachers  was  more  valuable  fhan  fheir  work  as  feaching  assisfanfs. 
Undergraduafe  sfudenfs,  however,  did  reporf  fhaf  fhe  monefary  compensafion 
influenced  fheir  decisions  fo  parficipafe  in  oufreach  programs.  Moreover,  mosf 
felf  fhaf  parficipafion  in  oufreach  programs  would  prove  beneficial  fo  fheir  career 
objecfives. 

The  oufreach  programs  also  appeared  fo  have  broader  insfifufional  impacfs. 
Discussions  wifh  universify  program  directors,  coordinafors,  and  managers 
indicated  fhaf  beffer  credibilify  and  improved  relations  wifh  fhe  local  communify 
were  some  of  fhe  benefifs  for  fhe  universify.^  Engaging  in  acfivifies  fo  improve 
fhe  local  schools  enhanced  fhe  image  of  fhe  insfifufion  in  fhe  eyes  of  fhe 
communify.  Moreover,  many  program  direcfors  reporfed  fhaf  K-12  feachers  fook 
pride  in  fheir  affiliafion  and  connecfion  wifh  fhe  insfifufion  and  fhaf  fhis  wenf  a 
long  way  foward  communify  building. 

A  few  of  fhe  universify  program  direcfors  suggesfed  fhaf  fhese  oufreach 
programs  could  also  make  science  courses  more  affracfive  fo  sfudenfs.  As  one 
program  manager  explained,  engaging  undergraduafe  science  majors  in  oufreach 
programs  is  good  for  fhe  universify.  Undergraduafe  science  core  requiremenfs 
fypically  have  tow  approval  ratings  among  many  of  fhe  science  and  nonscience 
majors.  Thus,  linking  science  courses  fo  oufreach  programs,  a  teafure  fhaf  mosf 
universify  sfudenfs  rate  highly,  may  be  one  way  fo  engage  sfudenfs  and  also 
solve  sfrafegic  communify  problems. 


^In  this  context,  program  director  refers  to  the  university  faculty  member  who  is  in  charge  of  the 
outreach  program,  not  to  the  program  director  within  the  federal  agency  that  is  sponsoring  the 
outreach  program.  Program  coordinators  and  managers  are  the  staff  members  responsible  for 
coordinating  the  efforts  of  the  program.  Typically,  these  persons  are  more  involved  in  the  day-to-day 
detailed  work  than  is  the  program  director. 
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Because  these  outreach  programs  offered  a  unique  type  of  teaching  and  learning 
experience  for  graduafe  sfudenfs,  some  program  direcfors  felf  fhaf  fhese 
programs  could  be  insfrumenfal  in  reshaping  and  improving  graduafe  education. 
Furfhermore,  some  program  direcfors  believed  fhaf  parficipafing  in  oufreach 
could  benefif  graduafe  sfudenfs  by  helping  fhem  wifh  fheir  feaching  skills,  which 
was  perceived  as  an  added  benefif  fo  fhe  universify,  parficularly  since  many 
graduafe  sfudenfs  lafer  serve  as  feaching  assistanfs  for  undergraduafe  science 
courses. 


Challenges  of  Outreach  Programs 

Oufreach  programs  fhaf  bridge  fhe  gap  befween  universifies  and  K-12  schools 
face  unique  challenges  from  each  of  fhese  culfures.  As  we  spoke  with  the 
different  program  participants,  a  clear  pattern  emerged  in  the  description  and 
identification  of  fhe  challenges.  In  the  minds  of  many  of  fhe  interviewees  that 
worked  primarily  in  the  K-12  schools — such  as  teachers,  program  coordinators 
and  managers — the  major  challenges  associated  with  outreach  had  to  do  with  the 
implementation  of  the  programs,  that  is,  the  obstacles  and  barriers  they  faced  in 
frying  fo  puf  fhe  oufreach  programs  info  pracfice.  Program  direcfors,  who  mosfly 
worked  wifh  fhe  universify,  described  fhe  challenges  fo  susfainability,  discussing 
fhe  obsfacles  and  barriers  associafed  wifh  creafing  and  susfaining  these  programs 
as  integral  components  of  fhe  universify. 


Implementation 

The  curricular  priorities  of  fhe  disfricf  creafed  fhe  major  implemenfafion 
challenges  for  some  of  fhe  oufreach  programs.  The  need  fo  improve  sfudenf 
achievemenf  in  mafh  and  liferacy  skills  in  urban  or  low-income  rural  school 
districfs  offen  fakes  precedence  over  fhe  need  fo  improve  science  instruction. 
Consequently,  the  time  available  for  science  insfrucfion  is  limifed.  Program 
coordinators  and  managers  reported  fhat  oufreach  programs  were  puf  on  hold 
frequenfly  during  fesf  fime  so  fhaf  classrooms  could  focus  on  "skill  and  drill 
exercises"  in  preparafion  for  upcoming  disfricf  and  sfafe  fesfs.  Moreover,  fhe 
emphasis  on  classroom  discipline  in  many  inner-cify  school  disfricts  creafed 
pofenfial  conflicfs  wifh  fhe  "hands-on"  nafure  of  fhe  classroom-based  oufreach 
programs. 
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Sustainability 

The  main  challenges  from  the  university  side  were  based  on  the  culture  of 
universities.  All  of  the  universities  we  visited  were  classified  as  Research  1 
universities  and  thus  emphasize  research  as  the  most  valued  aspect  of  university 
work,  leading  to  what  many  felt  was  an  extremely  narrow  focus  for  graduate 
education.  Many  felt  that  the  culture  of  the  university,  and  particularly  the 
science  departments,  fostered  an  environment  that  devalued  teaching  and 
discouraged  any  activities  that  might  distract  graduate  students  from  their  focus 
on  research. 

Another  challenge  was  a  lack  of  moral  support  for  outreach  programs  among 
science  faculty.  The  reasons  ranged  from  benign  disinterest  to  active  opposition 
to  the  fundamental  concept  of  the  outreach  program  itself.  For  example,  one 
interviewee  stated  "Most  faculty  don't  want  to  be  bothered  with  educational 
outreach  because  it  hinders  research  productivity."  Other  faculty  were  skeptical 
of  education  outreach  programs  and  viewed  them  as  having  very  little  impact  on 
achieving  the  stated  goals. 

A  final  challenge  involved  turf  issues  between  education  and  science  faculty. 
Many  program  directors  acknowledge  that  there  are  often  territorial  issues 
between  schools  of  education  and  the  physical  sciences  that  created  challenges 
when  faculty  from  these  two  groups  tried  to  work  together.  The  primary 
challenge  between  these  two  groups  centered  on  the  emphasis  on  content 
knowledge  versus  pedagogical  training.  Despite  these  challenges,  collaboration 
with  schools  of  education  was  critical  to  the  success  of  many  of  these  programs. 
In  addition  to  providing  pedagogical  training  for  the  graduate  and 
undergraduate  science  students,  some  programs  used  student-teacher  interns  to 
accompany  science  students  into  classrooms  as  part  of  their  training.  In  many 
instances,  visible  support  and  involvement  from  schools  of  education  gave 
outreach  programs  more  credibility  in  the  eyes  of  the  K-12  community. 


Characteristics  of  Effective  Programs 

Among  the  outreach  programs  we  visited,  we  identified  a  set  of  shared 
characteristics  that  enabled  these  outreach  programs  to  deal  effectively  with 
many  of  the  challenges  outlined  above.  These  characteristics  are  discussed  below 
and  may  have  important  implications  for  designing  effective  outreach  programs. 
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Shared  Vision 

Outreach  programs  require  an  extraordinary  amount  of  support  and  dedication 
from  program  parficipanfs.  Conversations  wifh  program  direcfors,  coordinators, 
and  managers  indicafed  fhaf  a  critical  parf  of  gaining  fhis  dedicafion  is  a  shared 
vision  of  fhe  imporfance  of  fhe  oufreach  program.  The  vision  is  a  unifying  force 
fhaf  serves  to  inspire  and  bring  fogefher  program  parficipanfs  from  diverse 
backgrounds.  Program  parficipanfs  shared  a  vision  fhaf  nof  only  encompassed 
larger  sociefal  aims,  such  as  social  justice,  addressing  problems  of  inequify,  and 
preparing  leaders  for  tomorrow's  sociefy,  buf  also  fhe  belief  fhaf  fhese  objectives 
could  be  mef  fhrough  improved  science  learning.  Thus,  improving  sfudenf 
learning  in  science  was  considered  a  means  fo  an  end,  buf  nof  fhe  end  ifself. 


Personnel 

Many  inferviewees  sfafed  fhaf  programs  and  efforfs  like  fhis  could  nof  be 
replicated  wifhouf  fhe  involvemenf  of  cerfain  kinds  of  key  individuals.  In  facf, 
fhe  term  "magicians"  was  used  fo  describe  fhese  all-imporfanf  individuals  who 
were  able  fo  make  fhings  happen  seemingly  ouf  of  fhin  air.  Each  program  had  a 
magician  and  we  were  able  fo  idenfify  similar  characferisfics  among  fhese 
individuals  fhaf  made  fhem  sfand  ouf.  Typically,  fhese  individuals  were 

•  senior  faculfy 

•  familiar  wifh  fhe  infricacies  of  fhe  universify  sysfem  and  undersfood  how  if 
worked 

•  viewed  as  eminenf  in  fheir  discipline 

•  nof  concerned  wifh  mainfaining  fhe  sfafus  quo. 

This  lisf  is  nof  meanf  fo  imply  fhaf  individuals  wifhouf  fhese  characferisfics 
cannof  confribufe  fo  a  successful  program,  buf  fhe  consisfency  of  fhese  four 
characferisfics  across  all  of  fhe  oufreach  programs  we  researched  underscores 
fheir  imporfance. 


Strategic  Planning 

Perhaps  fhe  mosf  critical  aspecf  in  fhe  success  of  many  of  fhese  programs  was 
having  fhe  fime  and  available  funding  necessary  for  sfrafegic  planning.  Alfhough 
mosf  programs  were  inifially  supporfed  on  limifed  budgefs,  fhere  was  plenfy  of 
freedom  and  flexibilify  for  sfrafegic  planning.  Mosf  program  direcfors  felf  fhaf, 
by  sfarfing  off  small,  fhey  had  fhe  abilify  fo  consfrucf  fhe  programs  fhe  way  fhey 
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wanted  to  without  having  to  deal  with  "the  strings  that  are  often  attached"  to 
federal  or  privafe  funding.  This  also  mean!  fhey  had  fhe  fime  fo  selecf  fhe 
appropriafe  personnel  and  build  a  solid  base  of  frusf  befween  fhe  universify  and 
fhe  schools. 


Infrastmctme  Support 

If  is  nof  uncommon  for  oufreach  programs  oufside  of  science  and  mafh  fo  utilize 
graduafe  and  undergraduafe  sfudenfs.  For  example,  social  science  and 
humanities  deparfmenfs  offen  have  oufreach  programs  with  similar  goals  that 
utilize  the  skills  and  talents  of  undergraduafe  and  graduafe  sfudenfs.  Finding 
ways  to  link  to  ongoing  programs  and  similar  efforts  is  important  in  building  an 
infrastructure  of  supporf  for  oufreach  programs  wifhin  fhe  universify.  For 
example,  many  sociology,  psychology,  and  efhnic  sfudies  deparfmenfs  have  also 
parficipafed  in  differenf  forms  of  oufreach  and  can  offer  commenfs  and 
suggesfions  abouf  making  inroads  info  disfricf  communifies.  Schools  of 
educafion  can  be  fhe  mosf  crifical  supporf  resource  for  oufreach  programs; 
developing  partnerships  with  these  schools  is  one  method  of  connecfing  fhe 
science  confenf  wifh  fhe  pedagogical  fraining. 


Locality 

Proximity  is  also  valuable.  Being  near  one  another,  particularly  when  the 
university  is  an  integral  part  of  fhe  same  communify,  allowed  fhe  universify  and 
K-12  schools  fo  develop  much  sfronger  bonds  fhan  ofherwise.  Moreover,  science 
sfudenfs  who  could  walk  fo  fhe  K-12  schools  were  able  fo  spend  more  of  fime  in 
fhe  classroom  wifh  sfudenfs  fhan  in  fraveling  fo  and  from  fhe  schools. 


Implications  and  Issues  for  Further  Study 

This  research  was  designed  fo  shine  a  spoflighf  on  a  few  programs  and  raise 
issues  for  furfher  explorafion.  Thus,  any  follow-up  work  should  be  aimed  af 
verifying  fhe  impacfs  and  challenges  identified  in  fhis  sfudy.  However,  we 
believe  fhaf  one  of  fhe  imporfanf  implicafions  here  is  an  awareness  of  fhe 
differenf  ways  fhaf  oufreach  programs  can  impacf  sfudenf  learning.  Alfhough  a 
single  oufreach  program  cannof  be  expecfed  fo  provide  all  fhe  resources  needed 
fo  improve  science  and  mafh  learning  in  K-12  classrooms,  good  oufreach 
programs  can  supporf  classrooms  and  provide  fhe  necessary  infrasfrucfure  fo 
ensure  fhaf  sfudenf  learning  in  science  and  mafh  is  nof  compromised  while 
schools  are  in  fhe  process  of  change.  As  schools  begin  developing  more  rigorous 
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science  and  math  curricula,  attracting  and  retaining  teachers  with  strong 
backgrounds  in  math  and  science,  and  creating  instructional  activities  aimed  at 
engaging  students  of  all  backgrounds,  science  graduate  and  undergraduate 
students  can  serve  as  an  important  tool  for  aiding  and  expedifing  fhaf  process. 
However,  for  programs  fo  capifalize  on  fhe  diverse  falenf  pool  of  fhese  sfudenfs, 
we  offer  fhe  issues  in  fhe  following  subsecfions  for  furfher  research: 


Evaluation  Issues 

Understanding  fhe  Benefits  of  the  University  Science  Students.  The  classroom- 
cenfered  programs  all  raise  fhe  quesfion  of  whefher  fheir  main  benefifs  flow  from 
fhe  enhanced  science  experfise  fhe  science  sfudenfs  provide  or  merely  from 
having  of  an  exfra  sef  of  hands. 

Measuring  Program  Impacts.  The  findings  of  fhis  sfudy  provide  a  sfarfing  poinf 
for  considering  and  developing  mefrics  fhaf  could  be  used  fo  evaluafe  fhe 
impacfs  of  fhese  programs.  The  broad  array  of  impacfs  suggesfs  fhe  need  for 
multiple  mefrics  fo  assess  programs  fully.  Moreover,  fhe  usual  mefrics  for 
evaluafion,  such  as  an  increase  in  mafh  or  science  fesf  scores,  may  nof  be  fhe 
mosf  significanf  or  fhe  mosf  appropriafe  oufcomes  fo  expecf  from  fhese 
programs.  Inferviewee  commenfs  suggesf  fhaf  some  of  fhe  greafesf  impacfs  were 
fhe  changes  in  fhe  affifudes  of  feachers  and  sfudenfs  toward  science.  One  may 
well  argue  that  these  sorts  of  changes  are  needed  before  feaching  practices  can 
change  meaningfully.  Assessmenfs  geared  toward  measuring  fhe  changes  in 
affifudes  toward  science  may  be  one  way  fo  evaluafe  fhe  impacfs  of  fhese 
programs.  Ofher  assessmenfs  could  focus  on  skills  fhaf  combine  scientific  process 
knowledge  wifh  scientific  confenf  knowledge.  Teachers  clearly  fell  fhaf  fheir 
sfudenfs  had  a  much  richer  undersfanding  of  science  fhan  disfricf  and  sfafe 
exams  indicafed  and  felf  fhaf  fhe  mulfiple-choice  formaf  of  fhe  exams  limifed  fhe 
abilify  of  fheir  sfudenfs  fo  demonsfrafe  fheir  undersfanding  of  science.  Many 
suggesfed  fhaf  evaluations  fhaf  assess  fhe  abilify  of  fheir  sfudenfs  fo  sef  up 
experimenfs  and  carry  ouf  differenf  science-relafed  fasks  would  be  better 
indicators  of  science  learning. 

Program  impacfs  should  also  consider  fhe  effecfs  of  oufreach  programs  on 
universify  science  sfudenfs.  Improved  communication  in  science,  increased 
enrollmenf  in  science  courses  as  a  resulf  of  fhe  addition  of  an  oufreach 
componenf  fo  fradifional  science  classes,  and  a  deeper  awareness  and 
undersfanding  of  societal  issues  are  all  important  impacts  that  were  mentioned 
in  this  study,  and  future  research  should  focus  on  how  to  measure  these  impacts. 
Strong  evaluations  that  measure  impacts  on  both  the  K-12  classroom  and 
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university  science  students  could  move  these  outreach  activities  from  peripheral 
programs  to  integral  components  of  fhe  universify  because  fhey  would  be 
viewed  as  having  measurable  posifive  impacfs  on  fhe  graduafe  sfudenfs  fhaf 
parficipafe  in  fhem,  as  well  as  on  fhe  K-12  sfudenfs  and  feachers. 

Finally,  evaluafion  should  be  ongoing  and  confinuous,  builf  in  fo  each  program 
from  fhe  sfarf. 


Design  Issues 

Designing  Outreach  Programs  that  Meet  the  Needs  of  K-12  Schools.  Targeting 
fhe  needs  of  fhe  K-12  schools  in  fhe  mosf  appropriafe  and  effecfive  manner  is  an 
importanf  issue  in  program  design.  The  programs  in  fhis  reporf  represenf  a  wide 
range  of  oufreach  acfivifies,  from  fhose  fhaf  require  little  classroom  confacf  (e.g., 
remofe  classroom  enhancemenf  programs)  fo  fhe  fhose  fhaf  involve  more 
susfained  classroom  inferacfion  (e.g.,  direcf  classroom  enhancemenf).  Thus,  one 
sfrafegy  for  fargefing  a  school's  needs  effectively  would  be  fo  develop  a 
universify-based  program  fhaf  confains  a  porffolio  of  differenf  infervenfion 
approaches  for  parfnering  fhe  falenfs  and  skills  of  universify  sfudenfs  wifh  K-12 
classrooms.  This  would  allow  oufreach  programs  more  flexibilify  in  coordinafing 
fheir  efforfs  wifh  K-12  schools.  For  example,  rafher  fhan  starting  out  with  direct 
enhancement  programs,  K-12  schools  and  universities  might  elect  to  begin 
working  together  through  remote  enhancement  programs  in  which  graduate 
students  interact  via  the  Internet.  If  more  supporf  is  needed  over  time,  fhe  frusf 
and  camaraderie  fhaf  has  been  builf  from  a  noninfrusive  mefhod  of  supporf  can 
be  used  fo  "smoofh  fhe  way"  in  developing  more  infensive  mefhods  of  oufreach. 

Creating  Pathways  to  Bring  Science  and  Math  Students  into  Teaching 
Professions.  An  imporfanf  part  of  improving  sfudenf  learning  in  science  is 
affracfing  more  feachers  wifh  backgrounds  in  science  and  mafh  fo  K-12 
classrooms.  Subjecf  matter  knowledge  is  importanf  in  feaching  because  if  affecfs 
fhe  confidence  fhaf  teachers  bring  to  the  subjects  they  teach  and  their  ability  to  be 
creative  in  developing  curriculum.  These  programs  may  serve  as  important 
filters  to  identify  sfudenfs  wifh  sfrong  science  confenf  knowledge  and  an  inferesf 
in  feaching  and  working  wifh  K-12  schools.  Thus,  linking  sfudenfs  in  fhese 
programs  wifh  ofher  opporfunifies  for  feaching  may  offer  one  way  fo  channel 
sfudenfs  info  feaching  careers. 


Implementation  Issues 

Allowing  Time  to  Build  Trust  Between  Universities  and  Schools.  Many  of  the 
implementation  issues  center  on  the  relationship  between  the  universities  and 
the  schools.  These  relationships  must  be  built  on  mutual  trust  and  respect 
between  the  university  and  the  schools.  Because  the  process  of  developing 
relationships  built  on  mutual  trust  takes  time,  programs  should  have  more  "lead 
time"  for  universities  and  schools  to  interact  with  each  other.  Most  program 
directors  commented  on  the  "need  to  hit  the  ground  running"  once  funding  was 
secured,  and  how  this  haste  created  an  atmosphere  of  poor  decisionmaking  and 
miscommunication. 

Supporting  and  Expanding  Existing  Programs.  Rather  than  creating  new 
programs  from  whole  cloth,  it  is  likely  to  be  more  cost-effective  to  identify 
existing  programs  that  have  demonstrated  some  measure  of  success  and  expand 
these  programs  to  other  schools  and  universities.  In  looking  at  partnerships,  we 
believe  that  the  characteristics  of  the  university  culture  are  critical  to  success  and 
that  focusing  on  state-supported  colleges  and  universities  or  historically  minority 
universities  with  long  histories  of  community  outreach  may  be  one  strategy 
toward  overcoming  many  of  the  challenges  faced  with  Research  I  universities. 
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1.  Introduction 


Not  since  the  Sputnik  "crisis"  of  the  1950s  has  so  much  attention  focused  on 
improving  science  educafion  in  fhe  Unifed  Sfafes.  Since  fhe  mid-1990s,  hundreds 
of  new  programs  fo  reform  science  educafion  in  various  ways  have  eifher  been 
creafed  or  formalized  from  prior  informal  acfivifies.^ 

However,  fhe  currenf  wave  of  science  educafion  reform  differs  from  fhe  earlier 
one  in  fundamenfal  ways.  The  reacfion  fo  Spufnik  was  driven  primarily  by 
nafional  securify  concerns  growing  ouf  of  fhe  Cold  War  wifh  fhe  Sovief  Union. 
Underlying  fhe  crisis  was  a  fear  fhaf  a  loss  of  U.S.  scientific  preeminence  puf  fhe 
nafion's  securify  af  risk.  Accompanying  fhis  was  fhe  blow  fo  nafional  pride  fhaf 
"losing"  fhe  space  race  represenfed.  Pressure  for  change  arose  largely  from  fhe 
scientific  esfablishmenf,  augmenfed  by  public  oufcry,  media  affenfion,  and 
heafed  debafe  af  all  levels  of  governmenf.  Response  fo  fhe  crisis  focused  on  how 
fo  produce  more  scientific  specialisfs  and  resfore  U.S.  ascendance  in  key  scientific 
fields  in  fhe  eyes  of  fhe  world  and  fhe  American  public.  Thus,  fhe  reforms  fhaf 
emerged  from  fhe  Spufnik  era  were  mosf  concerned  wifh  providing  advanced 
fraining  fo  fhe  mosf  promising  sfudenfs  fo  creafe  a  cadre  of  premier  scienfisfs. 

By  confrasf,  fhe  currenf  reform  is  more  concerned  wifh  providing  science  literacy 
for  all  citizens  and  increasing  opporfunifies  for  fradifionally  underserved 
sfudenfs  fo  have  access  fo  advanced  scienfific  knowledge  and  career 
opporfunifies.  The  crux  of  fhe  problem  in  fhe  lafe  1990s  and  early  2000s  is  nof  fhe 
need  for  more  scienfific  specialisfs  but  rather  for  a  more  scientifically  liferate 
workforce  and  cifizenry.  The  focus  in  fhis  currenf  reform  confers  on  economic 
compefifiveness  and  opporfunify  rafher  fhan  nafional  securify.  Thus,  if  is  nof 
surprising  fhaf  some  of  fhe  recenf  calls  for  improvemenf  in  science  educafion 
come  from  fhe  corporafe  world,  especially  fhe  high-fech  secfors.  As  one 
corporafe  execufive  stafed,  "Educafion  in  fhis  counfry  is  critical.  If  we  don'f 
continue  fo  produce  people  who  drive  fhe  process  of  innovation  and  fechnology, 
we  will  nof  succeed. Added  pressures  for  change  have  also  come  from 
governmenf  and  some  quarfers  of  fhe  scienfific  communify.  Thus,  currenf 
affempfs  fo  improve  science  educafion  are  nof  focused  on  increasing  fhe  pool  of 


^For  a  more  detailed  discussion  of  the  origins  of  the  science  education  reforms  of  both  the  1960s 
and  the  1980-1990s,  see  Raizen  (1997). 

'y 

^Quoted  in  Popper,  Wagner,  and  Larson  (1998),  p.  101. 
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Ph.D.  scientists  but  rather  on  raising  the  standards  for  a  baseline  science 
education. 

The  emergence  of  science  and  fechnology  as  fhe  major  engine  of  U.S.  economic 
developmenf  (see  Figure  1.1)  has  creafed  fwo  sefs  of  challenges  fhaf  make  efforfs 
fo  improve  science  education  paramounf.  The  firsf  challenge  is  how  fo  susfain 
fhis  engine — how  do  we  ensure  fhaf  fufure  generations  of  workers  will  have  fhe 
skills  and  preparation  needed  fo  susfain  fhe  scienfific  and  fechnological  needs  of 
fhe  fufure?  As  illusfrafed  in  Figure  1.1,  fhe  advancemenf  of  science  and 
fechnology  is  fueled  by  human  capifal — workers  who  creafe,  irmovafe,  and 
develop  tomorrow's  new  fechnologies.  Who  will  make  up  fhis  workforce?  By 
2015,  nonwhife  Americans  will  consfifufe  35  percenf  of  fhe  populafion  and  an 
even  greafer  proporfion  of  fhe  youngesf  workers,  ages  16-25.^  This  frend  is 
projecfed  fo  continue  until  fhe  United  Sfafes  will  evenfually  have  a  "minorify 
majorify" — fhaf  is,  a  greafer  fhan  50  percenf  nonwhife  populafion.  This  is  already 
frue  in  California,  fhe  mosf  populous  sfafe.  Are  all  groups,  including  fhose  fhaf 
are  fypically  underrepresenfed  in  science  and  mafh,  being  prepared  fo  confribufe 
fo  fhe  workforce?  Judging  from  currenf  sfafisfics,  fhe  answer  seems  fo  be  quite 
clearly  no.  Sfudenf  achievemenf  resulfs  on  fesfs  adminisfered  by  fhe  Nafional 
Assessmenf  of  Educafional  Progress  (NAEP)  indicafe  fhaf  for  fhe  mosf  parf, 
sfudenfs  are  performing  af  higher  levels  in  mafhemafics  and  science  fhan  did 
fheir  counferparfs  in  fhe  lafe  1970s;  however,  a  greafer  number  of  black  and 
Hispanic  sfudenfs  perform  af  basic  proficiency  levels  fhan  fheir  whife  and  Asian 
counferparfs  (NCES,  1997). 


RfiLNDMR1446-1.1 


Science  and  technology 


•  Societal  issues 

-  Scientifically  literate  society 

-  Fair  distribution  of  economic 
opportunities 


•  Human  capital  issues 

-  Quality  of  workforce 

-  Diversity  of  workforce 


Science  education 


Figure  1.1 — ^Relationship  Between  Scientific  and  Technological 
Advancement  and  Science  Education 


^Projections  developed  from  data  from  the  2000  U.S.  Census. 
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The  second  challenge  relates  to  the  equity  issues  created  by  a  society 
increasingly  reliant  on  science  and  technology.  Who  will  reap  the  rewards  of 
innovations  in  science  and  technology?  Who  will  bear  the  risks?  Scientific 
developmenfs  in  health  care,  agriculture,  and  information  technology  have 
created  the  need  for  a  scienfifically  liferafe  sociefy  able  fo  undersfand  fhe  long- 
ferm  consequences  of  fhese  recenf  advances.  Moreover,  economic  opporf unifies 
for  jobs  and  resources  will  favor  fhose  who  have  a  sound  and  fhorough 
undersfanding  of  science.  Consequenfly,  science  educafion  fhat  prepares  all 
sfudenfs  fo  confribufe  fo  and  to  benefit  from  opporfunifies  made  available  in  fhis 
sociefy  is  absolufely  crucial. 


Standards-Based  Reforms  Create  New  Classroom  Needs 

in  response  fo  growing  concerns  abouf  the  state  of  science  educafion,  several 
inifiafives  were  developed  fo  guide  fhe  current  reform  movemenf.  In  fhe  1980s, 
fhe  American  Chemical  Sociefy  (ACS),  the  Biological  Sciences  Curriculum  Study, 
the  Educational  Development  Center,  the  Lawrence  Hall  of  Science,  fhe  Nafional 
Science  Resources  Cenfer,  and  the  Technical  Education  Resources  Center  all 
developed  innovative  science  curricula.  In  1989,  the  American  Association  for  fhe 
Advancemenf  of  Science  (AAAS),  fhrough  ifs  Projecf  2061,  published  Science  for 
All  Americans,  and  in  1993,  published  Benchmarks  for  Science  Literacy. 

The  mosf  prominenf  among  these  guidelines  are  the  National  Science  Education 
Standards,  which  undergird  the  current  standards-based  science  reform. 

Released  in  1996  by  fhe  Nafional  Research  Council,  fhe  Sfandards  (as  fhey  are 
commonly  called)  are  designed  fo  guide  our  nafion  foward  a  scientifically  literafe 
sociefy.  A  hallmark  of  fhe  Sfandards  is  fheir  emphasis  on  inquiry-based 
approaches  fo  science  learning.  Inquiry-based  approaches  refers  fo  a  sef  of 
feaching  pracfices  fhaf  encourage  sfudents  fo  formulafe  quesfions  and  devise 
ways  to  answer  them.  Students  collect  data  and  decide  how  to  represent  them, 
organize  data  to  generate  knowledge,  and  test  the  reliability  of  the  knowledge 
they  have  generated.  As  they  proceed,  students  explain  and  justify  fheir  work  fo 
fhemselves  and  fo  one  anofher,  learn  fo  cope  wifh  such  problems  as  the 
limitations  of  equipmenf,  and  reacf  fo  challenges  fhaf  fhe  feacher  and  classmafes 
pose.  Af  all  sfages  of  inquiry,  teachers  guide,  focus,  challenge,  and  encourage 
sfudent  learning.'^  An  imporfanf  componenf  of  inquiry-based  approaches  fo 
science  learning  is  ifs  reliance  on  prepackaged  sets  of  science  maferials  and 
workbooks  fo  be  used  in  science  lessons  (often  referred  fo  as  kits)  rafher  fhan 


'^This  definition  is  paraphrased  from  National  Research  Council  (1996). 
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textbooks,  and  so  the  Standards  also  stress  the  need  to  create  resource-rich 
classrooms  using  a  multitude  of  science  materials  to  ensure  that  students  have 
ample  opportunity  for  engagemenf  during  fhe  learning  process. 

Mosf  of  fhe  feachers  we  inferviewed  for  fhis  sfudy  supporfed  fhe  new  emphasis 
on  inquiry-based  feaching  practices.  One  of  fhe  primary  reasons  was  fhaf  fhese 
pracfices  offered  feachers  a  mulfidimensional  approach  fo  teaching  science  that 
allowed  them  to  engage  all  students  regardless  of  abilify  level.  Many  of  fhe 
feachers  we  inferviewed  for  fhis  reporf  shared  numerous  accounfs  abouf  fhe 
difference  in  fheir  classrooms  and  their  ability  to  facilitate  learning  with  inquiry- 
based  teaching  practices. 

At  the  same  time,  however,  Standards-based  reform  has  creafed  a  number  of 
logisfical  challenges  for  many  classrooms.  As  a  consequence  of  many  of  fhe 
recommendafions  from  fhe  Standards,  more  classroom  time  is  required  for 
science  insfrucfion  because  the  use  of  kifs  and  ofher  supplemental  material 
requires  additional  setup  and  cleanup  time.  Moreover,  current  reforms 
emphasize  covering  fewer  fopics  in  greafer  depfh  fhan  a  fradifional  fexfbook- 
based  curriculum  and  require  feachers  fo  address  sfudenfs'  scientific  thinking 
more  directly.  Thus,  classroom  teachers  are  encouraged  to  be,  as  one  interviewee 
noted,  "guides  on  the  side"  rather  than  the  "sage  on  the  stage."  And  finally, 
feachers  are  challenged  fo  develop  sophisficafed  classroom  managerial  skills  fo 
gef  multiple  (perhaps  as  many  as  eight)  groups  of  sfudenfs  fo  remain 
simultaneously  "on  task"  with  their  science  lesson. 

As  a  consequence  of  fhese  challenges,  mechanisms  fo  supporf  the  efforts  of  K-12 
classrooms  fo  implement  standards  are  different  and  more  demanding  than 
those  needed  to  support  more  traditional  practices  in  the  classroom.  Teachers 
often  need  to  enlist  the  aid  of  confenf  experfs  and  resource  specialisfs  fo  ensure 
fhaf  fhe  inquiry-based  learning  guides  sfudenfs  fo  a  deeper  and  richer 
undersfanding  of  science.  Moreover,  feachers  also  need  anofher  sef  of  hands  fo 
help  wifh  all  fhe  differenf  group  acfivifies  fhaf  are  going  on  in  fhe  classrooms. 


The  Need  for  Outreach  Programs 

Education  oufreach  programs,  parficularly  those  that  link  universities  and  K-12 
schools,  are  potentially  attractive  mechanisms  for  acquiring  fhe  fype  of  supporf 
necessary  fo  adapf  fo  sfandards-based  reform  in  K-12  classrooms.  Our  research 
idenfified  more  fhan  200  educafion  oufreach  programs  fhaf  linked  K-12  schools 
fo  universities.  Typically,  federal  agencies,  privafe  foundafions,  or  corporations 
supporf  fhese  oufreach  efforfs.  Wifhin  academic  scientific  disciplines,  oufreach 
acfivifies  fo  K-12  schools  are  offen  funded  as  parf  of  larger  university  research 
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grants  that  stipulate  that  part  of  the  funding  be  used  for  educafional  purposes. 
This  gives  universities  considerable  freedom  in  deciding  on  fhe  fype  of  oufreach 
acfivify  fo  develop  and  implemenf. 

Typically,  fhese  oufreach  acfivifies  are  based  on  one  or  more  of  fhe  following 
sfrafegies  fo  improve  science  learning  in  K-12  classrooms: 

•  Enhanced  professional  development  for  science  teachers.  Many  teachers  of 
science  and  math  are  currently  teaching  outside  their  fields.  About  56  percent 
of  high  school  students  taking  physical  science  are  taught  by  out-of-field 
teachers,  as  are  27  percent  of  those  taking  mathematics.  These  percentages 
are  much  greater  in  high-poverty  areas.  Among  schools  with  the  highest 
minority  enrollments,  students  have  less  than  a  50-percent  chance  of  getting 
a  science  or  mathematics  teacher  who  holds  both  a  license  and  a  degree  in 
the  field  being  taught  (NCMS,  2000).  Thus,  one  set  of  strategies  focuses  on 
professional  development  programs  that  offer  opportunities  for  teachers  to 
broaden  and  deepen  their  disciplinary  and  pedagogical  knowledge  of  science 
and  math. 

•  Improved  curriculum  design.  Curriculum  design  programs  are  based  on  the 
notion  that  U.S.  science  curricula  are  too  diffuse  and  superficial:  "a  mile  wide 
and  an  inch  deep."  Curriculum  design  strategies  seek  to  focus  and  enhance 
science  curricula  through  classroom  experiments  and  hands-on  kits  rather 
than  just  the  use  of  textbooks. 

•  Reforming  science  pedagogy.  Closely  coupled  to  strategies  for  curriculum 
design  are  strategies  for  changing  the  pedagogy  of  teaching  science.  Studies 
in  the  early  1980s  of  hands-on  science  and  the  lecture-and-textbook  approach 
found  the  comparisons  to  favor  the  hands-on  programs  (Bredderman,  1983; 
Shymanky,  1989).  Thus,  many  pedagogical  changes  focus  on  having  students 
uncover  learning  at  their  own  pace,  using  inquiry-based  approaches  that  are 
centered  on  the  student  rather  than  on  the  teacher  (Anderson,  1999). 

•  Boosting  student  motivation.  Finally,  strategies  that  seek  to  motivate  and 
inspire  students  are  based  on  the  idea  that  students  are  uninspired  by  science 
or  that  students  that  begin  with  interest  in  science  are  quickly  turned  off  by 
the  dry  lecture  "factoid"  approach. 

Despite  the  limited  number  of  strategies  we  examined,  our  research  indicated 
that  there  is  great  variety  in  the  type  of  activities  that  universities  have  developed 
for  outreach.  These  activities  vary  in  four  important  ways:  the  structure  of  the 
program,  the  type  of  outreach,  the  kind  of  K-12  school  partnered  with,  and  the 
student  population  involved. 
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The  structure  of  these  partnerships  can  vary  tremendously.  Some  partnerships 
link  specific  academic  deparfmenfs  (e.g.,  biology,  chemisfry  or  physics)  and  a 
neighboring  school;  ofher  parfnerships  are  formed  wifhin  education  deparfmenfs 
fhaf  link  fo  K-12  schools  buf  utilize  science  faculfy  from  a  particular  deparfmenf 
for  fhe  oufreach  acfivifies;  still  ofhers  primarily  rely  on  efforfs  of  an  individual 
faculfy  member  fo  esfablish  and  mainfain  confacfs  wifh  K-12  schools.  Types  of 
programs  include  affer-school  acfivifies,  classroom  demonsfrafions,  lecfures 
abouf  careers  in  science,  and  "be  a  scienfisf  for  a  day"  programs.  These  programs 
also  vary  in  fhe  type  of  K-12  school  fhey  work  wifh,  ranging  from  schools  fhaf 
have  limifed  resources  for  science  insfrucfion  fo  affluenf  privafe  schools 
inferesfed  in  cuffing-edge  fechnology.  The  sfudenf  populations  vary  as  well, 
from  sfudenfs  who  have  expressed  minimal  inferesf  and  apfifude  in  science  fo 
college-bound,  high-achieving  sfudenfs  likely  fo  choose  careers  in  science  and 
research. 

Parfnerships  wifh  universities  also  offer  a  number  of  resources  fo  K-12  schools 
for  improving  science  and  mafh  education.  Universifies  have  fhe  facilities;  fhe 
fechnology;  and  perhaps  mosf  imporfanfly,  fhe  human  resources  fo  supporf  K-12 
classrooms  in  fheir  efforfs  fo  improve  science  learning.  Our  research  indicafed 
fhaf  science  educafion  oufreach  programs  involve  all  levels  of  "scientific  experfs" 
in  fheir  acfivifies  and  fhaf  programs  fhaf  specifically  recruif  graduafe  and 
undergraduafe  science  majors  for  oufreach  acfivifies  are  somewhaf  rare.  While 
undergraduafes  fypically  parti cipafe  in  oufreach  programs  via  sfudenf  service 
learning  programs,  fhe  parficipafion  of  graduafe  sfudenfs  in  oufreach  programs 
is  usually  more  informal.  Science  graduafe  sfudenfs  may  choose  fo  volunfeer 
fheir  fime  as  needed  or  work  wifh  research  advisors  who  may  be  involved  in 
oufreach  programs.  However,  recenfly  fhe  ufilizafion  of  science  sfudenfs  in 
educafion  oufreach  programs  has  recenfly  become  more  formalized.  For 
example,  feacher-scienfisf  programs  fhaf  fypically  relied  on  science  faculfy  fo 
work  wifh  feachers  in  fhe  laborafory  have  developed  ways  fo  encourage 
graduafe  sfudenfs  fo  become  involved.  Parfnerships  wifh  graduafe  sfudenfs  are 
offen  a  better  mafch  fhan  fhose  wifh  science  professors,  who  are  often  busy  wifh 
fheir  own  research  acfivifies  and  may  be  far  removed  from  fhe  K-12  world.  These 
programs  have  filled  a  unique  niche  in  oufreach  efforfs  because  fhey  allow 
graduafe  sfudenfs  fo  remain  linked  fo  fheir  research  and  yef  relafe  fheir  science 
fo  a  broader  audience. 


Rationale  for  the  Study 

Placing  graduafe  and  undergraduafe  sfudenfs  in  fhe  classrooms  fo  supporf 
feachers  in  K-12  science  and  mafh  insfrucfion  is  anofher  way  programs  are  using 
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the  scientific  expertise  of  universify  science  sfudenfs  in  science  educafion  reform 
efforfs.  In  1998,  fhe  Nafional  Science  Foundafion  (NSF)  creafed  fhe  Graduafe 
Teaching  Fellows  in  K-12  Educafion  (GK-12)  program.  The  GK-12  program 
provides  fellowships  for  science  graduafe  sfudenfs  (and  some  advanced 
undergraduafes)  fo  serve  as  resources  for  feachers  in  science  and  mafh 
insfrucfion  in  K-12  classrooms.  GK-12  fellows  receive  $18,000  per  year  fo  spend 
10  fo  15  hours  a  week  aiding  feachers  in  classroom  insfrucfion.  This  program 
came  under  infense  scrutiny  in  mid-2000,  when  fhe  NSF  director  requested  an 
increase  in  fhe  FY2001  budgef  for  fhis  program.  Questions  have  been  raised  in 
Congress  abouf  fhe  prudence  of  using  graduafe  sfudenfs  in  K-12  classrooms  and 
abouf  expanding  a  program  before  any  evaluafion  has  been  carried  ouf. 

The  need  for  evaluafion  raises  fhe  broader  question  of  whaf  is  known  abouf 
programs  fhaf,  like  GK-12,  seek  fo  ufilize  fhe  scienfific  expertise  of  graduafe  and 
undergraduate  sfudenfs  in  K-12  educafion  reform.  As  fhese  programs 
proliferafe,  undersfanding  fheir  impacfs  and  idenfifying  fhe  feafures  fhaf 
distinguish  successful  programs  from  nof-so-successful  ones  is  crucial  in 
informing  fhe  policy  decisions  abouf  how  besf  fo  help  K-12  classrooms  improve 
science  learning.  Highly  compefenf  and  skilled  science  graduafe  sfudenfs  are  a 
valuable  human  resource  in  our  sociefy  fhaf  may  be  useful  in  sfrengfhening 
science  insfrucfion  in  schools  across  fhe  counfry.  If  is  imporfanf  fhaf  we  develop 
fhe  mosf  effecfive  ways  of  using  fhese  graduafe  sfudenfs  in  our  educafional 
system. 


The  Research  Questions 

This  research  sfudy  examined  oufreach  programs  fhaf  ufilize  fhe  scienfific 
experfise  of  graduafe  and  undergraduafe  sfudenfs  in  K-12  educafion  and 
addressed  fhree  main  questions: 

1.  Whaf  are  fhe  impacfs  and  challenges  of  oufreach  programs  for  differenf 
parficipanfs  wifhin  K-12  schools? 

2.  Whaf  are  fhe  impacfs  and  challenges  of  oufreach  programs  for  differenf 
parficipanfs  wifhin  fhe  insfifufions  of  higher  educafion  fhey  parfner  wifh? 

3.  Whaf  are  some  feafures  of  programs  fhaf  addressed  fhese  challenges 
effectively  ? 

Clearly,  fhe  educafional  bottom  line  for  fhese  programs  is  fheir  impacf  on  sfudenf 
achievemenf.  This  research  sfudy,  however,  fakes  a  sfep  back  and  firsf  idenfifies 
fhe  impacfs  fhe  programs  have  on  differenf  parficipanfs.  Whaf  are  fhese 
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programs  doing?  Who  is  being  affected  and  how?  Are  these  impacts  linked  to 
student  achievement?  Moreover,  this  study  examines  the  impacts  on  all 
participants  in  outreach  programs,  not  just  on  K-12  classrooms.  The  second 
research  question  is  based  on  an  understanding  that,  for  programs  to  have 
meaningful  impacts,  there  must  first  be  some  sustainability.  An  often  neglected 
question  concerning  programs  that  partner  universities  and  K-12  schools  is 
"What  do  institutions  of  higher  education  gain  from  partnerships  with  K-12 
schools?"  Moreover,  what  policies  can  be  put  in  place  to  strengthen  links 
between  universities  and  K-12  schools  that  result  in  long-term  sustainable 
programs?  Finally,  the  third  research  question  seeks  to  identify  a  shared  set  of 
features  among  these  outreach  programs  that  might  inform  us  on  how  to  design 
more-effective  programs.  Information  from  this  research  should  contribute  to  the 
design  of  metrics  of  effectiveness  for  other  programs  with  similar  goals  and 
strategies  and  should  identify  several  of  the  key  issues  involved  in  program 
design  and  assessment  to  guide  more-comprehensive  efforts  at  scaling  up  and 
evaluating  similar  programs. 


Research  Approach  and  Methodology 

To  address  these  questions,  the  RAND  project  team  conducted  an  exploratory, 
case-study  effort  to  examine  eight  outreach  programs  that  utilize  graduate  and 
undergraduate  science  students.  We  interviewed  several  participants  in  these 
programs  about  program  impacts,  challenges,  and  strategies  for  developing 
effective  programs.  This  report  summarizes  the  interview  data  that  was  gathered. 
The  comments  are  organized  by  the  different  themes  that  emerged  from 
conversations  with  program  participants.  Thus,  unless  otherwise  noted,  all 
comments  and  assertions  made  within  this  report  are  based  solely  on  interviews. 
When  necessary,  direct  quotations  are  used  to  emphasize  certain  points  but  are 
not  used  to  justify  or  validate  a  particular  viewpoint  or  perspective.  One  of  the 
primary  aims  of  this  study  is  to  identify  the  types  of  research  issues  that  need  in- 
depth  exploration  so  that  the  effects  of  these  outreach  programs  can  be  better 
understood.  Another  potential  outcome  of  this  study  is  to  explore  the  usefulness 
of  gathering  this  type  of  information  prior  to  formal  evaluation  as  one  way  to 
better  align  the  program  assessments  with  both  anticipated  and,  particularly, 
unanticipated  program  impacts. 

The  research  approach  involved  three  steps:  program  selection,  data  collection, 
and  data  analysis. 
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Program  Selection 

To  select  the  programs  for  our  study,  we  first  compiled  a  list  of  over  200 
educafion  oufreach  programs  fhaf  involved  scienfisfs  from  all  levels  (e.g., 
bachelor's,  masfer's,  and  docforal  degrees  in  science)  and  career  backgrounds 
(e.g.,  academic  scienfisfs,  indusfry  scienfists,  engineers).  We  used  a  number  of 
differenf  dafabases  fo  generafe  fhis  lisf.  RAND's  RaDiUS  dafabase,  which  fracks 
all  federally  funded  research  and  developmenf  acfivifies,  allowed  us  fo  idenfify 
federal  science  programs  across  a  variefy  of  agencies,  including  NASA  and  fhe 
deparfmenfs  of  Energy,  Defense,  Agriculfure,  and  Educafion.  We  also  used  fhe 
NSF  awards  dafabase,  which  allowed  us  fo  focus  on  NSF-sponsored  projecfs. 
Finally,  we  used  Web  search  fechniques  fo  idenfify  programs  funded  by  privafe 
organizations,  such  as  Howard  Hughes  Medical  Insfifufe,  or  scientific  societies, 
such  as  fhe  American  Chemical  Sociefy  (ACS),  fhe  American  Physical  Sociefy 
(APS),  and  fhe  Federafion  of  American  Societies  for  Experimenfal  Biology 
(FASEB). 

In  collaboration  wifh  NSF,  we  developed  a  lisf  of  criferia  for  selecting  programs 
for  sife  visifs.  Resource  and  budgef  consfrainfs  limifed  fhe  scope  of  fhe  projecf, 
and  we  decided  fo  focus  on  one  subset  of  programs.  At  the  time  this  project, 
began,  the  GK-12  program  was  just  under  way,  and  we  narrowed  the  scope  of 
fhe  projecf  fo  focus  only  on  programs  fhaf  used  graduafe  and  undergraduafe 
science  sfudenfs  in  fheir  oufreach  acfivifies.  This  limifed  us  fo  approximafely  25 
programs  fhaf  had  significanf  involvemenf  of  fhis  group  of  early  career  scienfisfs 
in  fheir  oufreach  acfivifies. 

From  fhe  25  programs,  we  narrowed  fhe  selecfion  fo  fhose  fhaf  were  in  exisfence 
for  more  fhan  five  years.  One  of  fhe  key  research  areas  we  wanfed  fo  address  in 
fhis  sfudy  is  sfrafegies  fhat  lead  fo  effecfive  and  susfainable  oufreach  programs, 
so  "years  of  exisfence"  was  used  as  one  measure  of  susfainability.  To  gef  af  some 
ideas  about  effectiveness,  we  talked  with  various  NSF  program  directors  that  had 
experience  working  with  outreach  programs  using  scientists.  We  asked  them  to 
share  with  us  ideas  about  what  makes  a  program  effective  and  to  suggest  some 
features  we  might  look  for  in  selecting  programs. 

By  fhis  poinf,  we  had  idenfified  15  pofenfial  programs  for  sfudy.  Because  ifs 
mission  includes  supporfing  acfivifies  designed  fo  increase  fhe  parficipafion  of 
women  and  minorities  and  ofhers  underrepresenfed  in  science  and  fechnology, 
NSF  suggesfed  fhaf,  among  fhese  programs,  we  selecf  programs  whose  oufreach 
acfivifies  focused  on  schools  in  underserved  communifies.  These  schools  are 
characferized  by  low-income,  primarily  African-American  and  Hispanic, 
sfudenfs  and  schools  in  urban  and  rural  settings.  This  is  an  imporfanf  poinf 


10 


because  many  of  these  programs  had  to  face  difficult  circumstances  that  may  not 
be  indicative  of  most  education  outreach  programs.  Over  half  of  the  programs 
we  visited  were  doing  outreach  under  some  very  tough  conditions  but  where  the 
need  for  success  is  perhaps  the  greatest.  This  issue  is  discussed  in  greater  depth 
in  Section  2. 

In  all,  we  selected  eight  programs  for  site  visits.  These  programs  had  similar 
goals:  enhancing  science  education  through  partnerships  with  universities.  All  of 
the  programs  were  university-based,  which  means  that  the  funding  went  to  the 
university  and  that  the  outreach  activity  typically  involved  sending  the  scientists 
out  into  the  schools.  Programs  differed  in  their  funding,  with  some  programs 
being  solely  supported  by  federal  or  private  funding,  and  others  being  supported 
by  both  federal  and  private  funding.  Programs  varied  in  the  grade  level  targeted, 
and  there  was  a  mix  of  elementary,  middle,  and  high  school  grade  levels,  as  well 
as  scientific  disciplines  targeted.  Some  programs  were  as  brief  as  two  weeks  in 
the  summer,  while  others  were  year-round.  The  programs  we  selected  were  in 
various  geographic  regions  of  the  country  (the  Northeast,  the  Southeast,  and  the 
West  Coast).  The  programs  differed  in  the  scope  of  impact,  some  were 
districtwide  efforts,  others  were  part  of  school  clusters,  and  others  were  much 
smaller  partnerships  initiated  by  schools  contacting  a  particular  faculty  member 
at  the  university  to  initiate  the  effort.  Section  2  discusses  the  programs  in  more 
detail.  The  names  and  institutional  affiliations  of  the  programs  have  been 
withheld  to  honor  guarantees  of  confidentiality. 


Data  Collection 

The  data  on  which  this  study  is  based  were  collected  from  interviews  with 
program  directors,  program  coordinators  and  managers,^  K-12  teachers,  and 
graduate  and  undergraduate  students  that  participated  in  each  of  the  outreach 
programs  we  selected.  Because  of  budgetary  and  logistical  constraints,  we  did 
not  interview  K-12  students.  Also,  many  of  the  interview  questions  focused  on 
programmatic  and  implementation  issues,  and  we  felt  it  was  more  cost-effective 
to  meet  with  those  who  were  most  familiar  with  these  issues. 

In  all,  we  conducted  45  interviews  with  83  individuals  in  8  different  programs. 
Site  visits  typically  lasted  2-3  days  and  usually  included  interviews  with  the 
program  director  and  1-2  program  coordinators  and  managers,  focus  group 
interviews  with  teachers  (usually  3^  teachers  per  focus  group),  and  focus  group 


^Program  coordinators  and  managers  are  staff  members  responsible  for  coordinating  the  efforts 
of  the  program.  Typically,  these  persons  are  more  involved  in  the  day-to-day  detailed  work  than  the 
program  director. 
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interviews  with  graduate  students  and  /  or  undergraduate  students  (2-3  students 
per  focus  group).  The  interviews  with  program  directors  and  program 
coordinators  were  individual  semistructured  interviews  and  took  place  at  the 
university  affiliated  with  the  outreach  program.  The  interviews  followed  a 
sfandard  protocol  (see  Appendix  A),  buf  fhe  conversafion  was  allowed  to  move 
beyond  fhe  inferview  quesfions  to  explore  ofher  issues.  These  inferviews 
generally  lasfed  one  hour,  alfhough  many  wenf  longer.  The  inferviews  wifh  fhe 
feachers  usually  took  place  af  fhe  K-12  school  and  used  a  focus  group  formaf. 
Focus  group  interviews  generally  lasted  2  hours.  When  possible,  a  focus  group 
formaf  was  also  used  fo  inferview  graduafe  sfudenfs,  and  fhese  inferviews  fook 
place  af  fhe  universify.  Scheduling  conflicfs  wifh  undergraduates  made  focus 
group  inferviews  difficulf,  so  fhey  were  offen  individual  semisfrucfured 
interviews.  During  the  site  visits,  we  also  attended  workshops  and  seminars; 
collected  materials  and  literature  related  to  the  programs;  and  in  some  cases, 
attended  hands-on  training  sessions  with  K-12  teachers.  While  our  visits  to  K-12 
schools  did  not  involve  classroom  observations,  we  did  walk  around  the  schools 
and  take  note  of  fhe  classrooms  and  fhe  resources  available  for  science 
insfrucfion. 

To  encourage  complete  candor  in  fhe  responses,  we  emphasized  fo  fhe 
interviewees  fhaf  fhis  sfudy  was  nof  linked  fo  evaluation  or  funding  and 
promised  fhe  parficipanfs  complefe  confidenfialify.  As  a  resulf,  fhe  inferviews 
were  carried  ouf  in  an  afmosphere  of  relaxed  informalify  fhaf  allowed 
parficipanfs  fo  open  up  and  express  fheir  fhoughfs  and  opinions  candidly. 

Our  inferview  protocol  used  similar  quesfions  for  all  fhe  parficipanfs,  which 
allowed  us  fo  check  differenf  responses  againsf  differenf  groups  and  look  for 
corroborafion  among  fhe  responses. 


Data  Analysis 

Our  inferviews  form  fhe  basis  of  fhe  analyses.  Affer  fhe  inferview  fapes  had  been 
franscribed,  a  second  researcher  read  fhrough  fhe  inferviews  and  organized  fhe 
responses  based  on  fhe  frequency  wifh  which  cerfain  ideas  and  fhemes  were 
menfioned.  The  dafa  were  enfered  info  a  spreadsheef  and  grouped  according  fo 
fhe  source  of  fhe  commenf  (e.g.,  program  direcfor,  teacher,  program  manager) 
and  fhe  main  fheme  of  fhe  commenf.  Time  and  budgefary  consfrainfs  limifed  fhe 
number  of  programs  we  interviewed,  and  our  sample  size  is  foo  small  fo  make 
any  assertions  abouf  frue  representafion  or  unbiased  sampling.  Program 
parficipanfs  reviewed  our  analyses  fo  ensure  factual  accuracy  and  to  have  the 
opportunity  to  comment. 
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Organization  of  the  Report 

The  following  sections  of  the  report  provide  details  about  the  programs 
examined  and  the  study's  main  findings.  Section  2  describes,  in  detail,  the 
features  and  design  of  the  eight  programs  we  visited.  The  section  is  intended  to 
provide  the  reader  with  a  sense  of  the  diversity  of  the  programs  and  an 
understanding  of  the  programmatic  goals  and  objectives  of  each  program. 
Section  3  addresses  the  first  research  question  in  our  study  by  discussing  the 
major  impacts  and  challenges  of  the  outreach  programs  for  K-12  classrooms. 
Based  on  interview  data  gathered  primarily  from  K-12  teachers,  this  section 
discusses  the  effect  these  programs  had  on  classroom  practices,  classroom 
instruction,  and  student  attitudes  toward  science.  Comments  from  interviewees 
form  the  basis  for  this  discussion  and  are  used  to  articulate  and  support  various 
themes  in  the  section;  they  do  not  necessarily  reflect  broad  or  representative 
opinions  on  certain  topics.  Section  4  addresses  the  question  of  impacts  and 
challenges  from  the  perspective  of  university  participants.  This  section  draws  on 
comments  from  program  directors,  coordinators  and  managers,  and  graduate 
and  undergraduate  students  to  discuss  impacts  on  the  university  as  a  whole,  in 
identifying  some  of  the  challenges  within  the  higher-education  culture,  this 
section  raises  the  question  of  whether  outreach  programs  can  offer  more  benefits 
to  institutions  of  higher  education,  and  particularly  to  the  university  science 
students  that  participate  in  these  programs.  Section  5,  concludes  the  report  by 
drawing  together  the  different  themes  presented  in  earlier  sections  and 
discussing  the  "lessons  learned"  from  these  outreach  programs.  We  address  the 
final  research  question  and  list  the  different  characteristics  that  led  to  the 
development  of  sustainable  and  effective  programs.  We  conclude  the  section 
with  implications  for  policy  and  recommendations  for  further  research. 
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2.  Program  Descriptions 


This  section  describes  the  eight  educational  outreach  programs  we  examined  for 
this  study.  We  begin  this  section  by  discussing  some  of  fhe  features  these 
programs  had  in  common.  We  follow  wifh  a  general  descripfion  of  fhe  programs, 
cafegorizing  fhem  by  fheir  approach  fo  enhancing  science  educafion.  This  general 
descripfion  includes  fhe  programmatic  goals  and  objectives  of  fhe  programs  and 
defailed  informafion  abouf  fheir  size  and  scope.  This  secfion  provides  fhe 
background  informafion  needed  for  undersfanding  fhe  discussions  of  impacfs 
and  challenges  fhaf  follow  in  Secfions  3  and  4. 


Overview  of  fhe  Programs 

A  number  of  reporfs  have  discussed  oufreach  programs  and  fhe  role  fhat 
scienfisfs  have  played  in  science  educafion  reform.  ^  This  report  adds  to  that  body 
of  liferafure  by  focusing  on  programs  thaf  ufilize  graduafe  and  undergraduafe 
science  sfudenfs  and  fheir  role  in  science  educafion  reform.  This  reporf  also  adds 
fo  fhe  liferafure  by  focusing  on  programs  fhaf  share  fwo  key  feafures:  long-ferm 
experience  or  commifmenf  (af  leasf  five  years)  fo  K-12  science  educafion 
oufreach  and  a  particular  inferesf  in  working  across  entire  school  populations  in 
under  served  communifies,  nof  jusf  wifh  self-selecfed  or  gif  fed  sfudenfs.  These 
fwo  criferia  distinguished  fhe  programs  we  examined  from  virfually  all  of  fhe 
ofher  educafion  oufreach  programs  we  idenfified  in  our  inifial  program  selecfion 
phase.  Alfhough  many  of  fhose  programs  also  focused  on  underserved 
communifies,  fhey  were  nof  infended  for  all  sfudenfs  buf  rafher  only  fhose  fhaf 
had  shown  inferesf  in  science,  demonsfrafed  apfifude  in  science,  or  attended 
schools  in  which  fhere  was  an  awareness  of  fhe  imporfance  of  science  educafion. 
By  confrasf,  several  of  fhe  programs  included  in  fhis  sfudy  are  broadly  fargefing 
fheir  oufreach  acfivifies  toward  communifies  and  fhe  differenf  schools  wifhin 
fhese  communifies. 

Oufreach  programs  fhaf  focus  on  underserved  communities  are  especially 
important  for  sfudy  for  a  number  of  reasons: 


^See  for  example.  National  Science  Resource  Center  et  al.  (1997)  and  Sandia  National 
Laboratories  (undated). 
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•  The  persistent  achievement  gap  in  math  and  science.  A  tremendous 
achievement  gap  between  whites  and  students  of  color  in  math  and  science 
still  exists.  Very  few  sfrafegies  seem  able  fo  address  fhe  differenf  variables 
fhaf  may  accounf  for  fhis.  Sfudying  ouf reach  programs  fhaf  show  some 
measure  of  success  in  engaging  diverse  populafions  in  mafh  and  science  may 
be  fhe  firsf  sfep  in  developing  creafive  and  innovative  ways  of  solving  fhis 
problem. 

•  Lack  of  attention  to  science  instruction  in  elementary  grades.  The  focus  on 
demonsfrafing  achievemenf  in  reading  and  mafh  on  sfandardized  fesfs  offen 
means  fhaf  ofher  subjecfs  are  given  less  attention  in  schools  in  underserved 
communities.  Alfhough  fhis  indicafes  fhaf  mafh  is  getting  adequate  attention 
in  many  schools,  this  may  not  be  the  case  for  science,  especially  in 
elemenfary  school  grades.  Middle  school  feachers  we  inferviewed 
underscored  fhe  imporfance  of  beginning  science  insfrucfion  af  fhe  earliesf 
possible  grades.  Thus  sfudying  oufreach  programs  fhaf  have  found  ways  fo 
bring  fhe  focus  on  science  educafion  fo  elemenfary  grades  may  offer  valuable 
sfrafegies  for  success  and  achievemenf  in  science. 

•  Schools  in  underserved  communities  represent  "high-risk,  high-payoff" 
investments.  Alfhough  schools  in  underserved  communities  offer  a  number 
of  challenges,  a  recenf  RAND  reporf  (Grissmer  ef  al.,  2000)  indicafes  fhaf 
federal  invesfmenfs  fargefed  toward  sfudenfs  af  fhe  lowesf  end  of  fhe 
socioeconomic  specfrum  are  offen  fhe  mosf  effective  in  yielding  performance 
gains.  Thus,  if  makes  sense  fo  sfudy  programs  for  which  fhe  value  of  fhe 
oufreach  may  be  greafesf. 

Wifh  fwo  excepfions,  all  fhe  programs  selected  shared  fhis  common  feafure  of 
being  engaged  in  oufreach  acfivifies  in  underserved  communities.  The  ofher  fwo 
programs  had  a  particularly  successful  hisfory  of  oufreach,  and  we  felf  fhis 
aspecf  would  be  useful  in  our  discussion  and  analysis  of  successful  sfrafegies. 


Program  Characteristics 

The  primary  goal  of  all  of  fhe  programs  we  visifed  was  fhe  enhancemenf  of  K-12 
science  or  mafh  insfrucfion.  Mosf  programs  fried  fo  align  fheir  oufreach  wifh  fhe 
sfandards-based  reform  recommendations  and  supporfed  the  emphasis  on 
inquiry-based  science  instruction.  However,  the  approaches  these  programs  used 
to  enhance  science  instruction  differed.  Some  programs  soughf  fo  encourage 
inquiry-based  feaching  pracfices  by  pairing  feachers  wifh  graduafe  sfudenfs  in 
research  laborafories.  Ofher  programs  supporfed  K-12  classrooms  fhrough  Web- 
based  technology  fhaf  allows  sfudenfs  fo  ask  scienfific  quesfions  of  graduafe 


15 


students  via  e-mail.  Still  other  programs  placed  graduate  students  in  the 
classroom  with  teachers  to  help  implement  inquiry-based  practices  in  the 
classroom.  In  the  next  subsection,  we  describe  in  detail  the  different  approaches 
used  to  improve  science  learning  in  K-12  classrooms.  The  following  cafegories 
group  fhe  oufreach  programs  in  our  sfudy  according  fo  mefhod  of  infervenfion: 
direcf  classroom  enhancemenf,  feacher  preparafion,  feacher  researcher,  remofe 
classroom  enhancemenf,  and  developmenf  of  insfrucfional  maferials.  We  use 
fhese  cafegories  fhroughouf  fhis  reporf  when  referring  fo  commenfs  from 
program  parficipanfs.  Table  2.1  summarizes  some  of  fhe  characferisfics  of  fhe 
eighf  oufreach  programs.  A  more  defailed  explanation  of  each  program  is  given 
in  Appendix  B. 


Description  of  the  Different  Program  Approaches 

Direct  Classroom  Enhancement  Programs 

This  cafegory  describes  a  sef  of  programs  in  which  science  graduafe  and/ or 
undergraduafe  sfudenfs  work  in  classrooms  wifh  K-12  feachers  fo  supporf  fhem 
in  science  and  mafh  insfrucfion.  Our  inferviews  and  discussions  wifh  feachers 
and  graduafe  sfudenfs  in  fhese  programs  indicafed  fhaf  supporf  from  graduafe 
and  undergraduafe  sfudenfs  often  means  assisting  teachers  in  setting  up 
different  science  experiments  and  activities,  explaining  challenging  scientific 
concepfs  fo  the  students,  working  with  teachers  in  the  classroom  to  observe  and 
help  different  groups  of  sfudenfs,  and  assisfing  wifh  curriculum  developmenf. 
We  also  found  fhaf,  in  some  insfances,  particularly  wifh  fhe  graduafe  sfudenfs, 
fhe  supporf  can  mean  feaching.  Mosf  programs  encouraged  graduafe  sfudenfs 
and  feachers  fo  meef  prior  fo  classroom  activities  fo  discuss  how  fhey  should 
work  fogefher  in  fhe  classrooms,  buf  many  feachers  and  sfudenfs  offen  said  fhey 
had  difficulfy  finding  fime  for  fhis.  Teachers  and  graduafe  sfudenfs  alike 
commenfed  on  an  inifial  period  of  awkwardness  when  firsf  working  fogefher  in 
fhe  classroom.  However,  for  many,  fhis  awkwardness  dissolved  wifhin  a  few 
weeks.  Sfudenf  scheduling  concerns  typically  determined  the  placement  of 
sfudenfs  in  parficular  classrooms,  and  fhis  was  particularly  challenging  for 
undergraduafes.  If  a  sfudenf  had  an  opening  in  his  or  her  schedule  during  a  fime 
fhaf  science  is  faughf  in  fhe  classroom,  fhe  sfudenf  was  paired  wifh  fhe  feacher  in 
fhaf  classroom.  Wifh  graduafe  sfudenfs,  fhere  was  more  variafion.  For  example,  a 
graduafe  sfudenf  may  be  more  comforfable  wifh  middle  and  high  school 
sfudenfs  and  so  would  be  placed  in  fhese  grades.  In  some  cases,  feachers  would 
requesf  a  sfudenf  based  on  a  specific  confenf  need,  such  as  physics  or  chemisfry. 
All  fhe  feachers  we  inferviewed  wanfed  fo  have  graduafe  and  undergraduafe 


Table  2.1 

Characteristics  of  CXitreadi  Programs 
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students  work  with  them  in  their  classrooms.  Depending  on  the  program, 
students  can  spend  as  little  as  3  hours  per  week  in  a  classroom  to  up  to  20  hours 
per  week.  Because  of  the  demands  on  student  time,  most  of  fhese  programs  offer 
some  sorf  of  compensation  for  parficipafion  in  fhe  oufreach  program.  In  fhe  case 
of  undergraduafe  sfudenfs,  sfudenf  service  learning  poinfs  or  universify  credif 
hours  foward  core  requiremenfs  were  used  fo  compensafe  sfudenfs  for  fheir 
fime.  Graduafe  sfudenfs,  on  fhe  ofher  hand,  received  a  sfipend  as  compensafion 
for  fheir  fime  and  efforf. 


Teacher-Preparation  Program 

This  program  was  an  oufgrowfh  of  a  direct  classroom  enhancement  program  that 
placed  graduate  students  into  K-12  classrooms  to  support  teachers  in  science  and 
mathematics  instruction.  Having  assessed  that  the  need  for  well-frained  feachers 
in  underserved  communifies  was  a  crifical  issue  in  many  of  fhe  schools  in  fhe 
surrounding  communify,  fhe  direcfor  resfrucfured  fhe  oufreach  program  so  fhaf 
funding  fradifionally  used  fo  supporf  one  graduafe  studenf  was  now  used  fo 
supporf  fhe  fraining  of  undergraduafe  science  and  mafh  majors  fo  become  K-12 
feachers.  Alfhough  fhis  program  has  now  evolved  info  a  feacher  preservice 
program,  we  include  if  because  of  fhe  years  of  experience  fhis  program  has  in 
placing  mafh  graduate  students  in  K-12  classrooms.  We  believed  that  the 
program  directors  and  coordinators  would  have  a  rich  history  to  draw  on  in 
discussing  some  of  fhe  challenges  in  implementing  "GK-12  like"  programs. 
Moreover,  because  fhe  program,  in  fhe  end,  found  more  value  in  preparing 
undergraduafe  science  and  mafh  majors  for  feaching  careers,  we  felf  fhaf  fhe 
program  parficipanfs  could  raise  some  imporfanf  concerns  abouf  fhe  ulfimafe 
goals  and  objectives  of  fhe  GK-12  program  and  ofhers  similar  fo  if.  Some  of  fhe 
unique  aspecfs  of  fhis  program  are  ifs  uncompromising  sfance  on  fhe  imporfance 
of  preparing  mafh  and  science  majors  for  feaching  careers  and  ifs  focus  on 
recruifing  sfudenfs  of  color  info  fhe  feacher-preparafion  program.  Because 
recruifing  mafh  and  science  majors  info  feaching  careers  can  be  a  challenge,  fhis 
program  focuses  on  identifying  mafh  and  science  majors  as  early  as  fheir  junior 
year  in  college.  The  mafhemafics  componenf  of  fhis  program  is  a  joinf 
collaboration  between  the  Mathematics  Department  and  the  School  of  Education 
and  recruifs  junior  and  senior  undergraduafe  mafh  majors  fo  K-12 
schoolfeaching  careers.  During  fheir  senior  year,  undergraduafes  have  an 
opporfunify  fo  infern  in  school  classrooms.  The  infernship  experience,  which  is 
offered  during  fhe  winfer  and  spring  quarfers,  involves  approximafely  five  hours 
of  classroom  parficipafion  per  week  wifh  an  individual  sfipend.  A  considerable 
amounf  of  sfudenf  fuforing  and  feaching  is  involved  in  fhe  classroom 
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participation.  The  fifth  year  consists  of  a  full  year's  feaching  experience  under  an 
emergency  feaching  credential  wifh  a  parallel  seminar  on  sfudenf  feaching 
followed  by  additional  coursework  fhe  nexf  summer.  Sfudenfs  who  complete  the 
program  receive  a  university-recommended  single-subject  teaching  credential 
with  a  cross-cultural  language  and  academic  development  emphasis  and  a 
Master  of  Educafion  degree. 


Teacher  Researcher  Programs 

This  cafegory  refers  fo  a  sef  of  programs  fhaf  paired  feachers  (usually  high  school 
feachers)  wifh  graduafe  sfudenfs  in  research  laborafories.  The  graduafe  sfudenfs 
in  fhese  programs  serve  as  mentors  to  teachers  engaging  in  laboratory  research. 
In  these  typically  year-round  programs,  teachers  work  with  the  graduate 
students  during  the  summer  on  a  research  project  and  use  the  project  as  the  basis 
for  developing  science  projecfs  or  science  acfivifies  for  sfudenfs  in  the  fall. 
Depending  on  fhe  program,  fhe  summer  workshop  can  lasf  eifher  fwo  weeks  or 
six  weeks.  In  addition  fo  research,  feachers  also  have  opporfunifies  to  share  ideas 
with  fellow  feachers  abouf  ways  fo  incorporafe  whaf  they  have  learned  into  their 
daily  classroom  practices  and  curriculum  development.  During  the  academic 
year,  graduate  students  continue  to  interact  and  support  the  teachers  either 
through  classroom  visits  or  via  e-mail  where  graduate  students  are  available  to 
address  any  questions  the  teachers  may  have  as  they  transfer  fheir  summer 
projecfs  fo  fhe  classroom.  In  many  insfances,  if  may  be  questions  relafed  fo  using 
a  parficular  fechnique,  such  as  gel  elecfrophoresis  or  fhin-layer  chromafography. 
These  programs  focus  on  learning  new  techniques  and  developing  curriculums 
fhaf  can  enhance  science  learning  in  fhe  classrooms.  Many  of  fhese  programs 
developed  as  a  resulf  of  science  educafion  reform  fhat  recommended  inquiry- 
based  learning  serve  as  fhe  foundation  for  science  insfrucfion.  Because  many 
feachers  did  not  have  opportunities  to  experience  inquiry-based  learning 
themselves,  the  purpose  of  fhese  programs  is  fo  give  feachers  "real  life" 
experience  doing  science  and  an  understanding  of  whaf  fhe  process  of  science  is 
all  abouf.  To  be  selected  for  these  programs,  teachers  fill  ouf  applications 
describing  fheir  science  background  and  interests.  Graduate  students  we 
interviewed  stated  that  they  generally  selected  teachers  based  on  the  scientific 
inferesfs  of  fhe  feachers.  These  programs  do  nof  exclusively  recruif  graduafe 
sfudenfs  as  parfners  for  science  feachers,  and  feachers  have  opporfunifies  to 
work  with  researchers  in  industry,  as  well  as  science  professors.  Depending  on 
fhe  program,  graduafe  sfudenfs  fhaf  parficipafe  in  fhis  program  can  earn  eifher  a 
sfipend  or  credif  hours  toward  their  graduate  degrees. 
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Remote  Classroom  Enhancement  Programs 

This  program  supports  K-12  teachers  in  their  science  instruction  by  bringing  the 
scientific  expertise  of  graduafe  sfudenfs  info  fhe  classroom  via  e-mail. 
Formulating  and  articulating  questions  is  an  imporfant  parf  of  inquiry-based 
science,  and  fhis  program  helps  sfudenfs  fo  develop  fhis  skill  by  providing  a 
means  for  fhem  fo  ask  scienfific  experfs  different  science-related  questions.  The 
graduate  students  primarily  serve  as  content  experts  in  answering  these 
questions.  This  program  exhibits  the  most  variation  in  how  it  is  used  to  enhance 
science  learning  because  teachers  decide  when  and  how  to  use  the  expertise  of 
fhe  graduafe  sfudenfs.  In  some  insfances,  program  use  can  be  highly  sfrucfured, 
developing  fhe  quesfions  fo  send  fo  the  graduate  students  as  a  rigorous 
classroom  exercise,  or  can  be  more  recreational,  as  a  reward  for  good  classroom 
behavior.  Participation  in  fhis  program  is  volunfary  for  bofh  fhe  graduate 
students  and  the  K-12  classroom  teachers.  The  program  design  allows  the 
graduate  students  to  decide  the  degree  to  which  they  want  to  participate  in  this 
program.  This  program  welcomes  participation  from  all  levels  of  scienfisfs,  nof 
jusf  graduafe  sfudenfs,  alfhough  graduafe  sfudenfs  consfifufe  a  subsfanfial 
number  of  fhe  parficipanfs.  Many  of  fhe  scientisfs  we  spoke  fo  said  fhaf  fhey 
enjoyed  parficipafing  in  fhis  program  because  if  helped  fhem  arficulafe  ideas  and 
broaden  their  knowledge  about  many  different  science  topics. 


Development  of  Instructional  Materials 

This  program  developed  instructional  materials  that  can  be  incorporated  into 
science  curriculums  for  grades  5-12.  Undergraduafes,  assisfed  by  local  high 
school  sfudenfs,  assume  fhe  main  responsibilify  for  building  and  mainfaining 
differenf  insfrucfional  maferials.  Undergraduafes  also  supporf  feachers  and 
improve  fheir  feaching  skills  during  fhe  academic  year  by  infroducing  fhese 
maferials  info  local  science  classes.  Because  undergraduafes  generally  have  more 
time  fhan  graduafe  sfudenfs,  fhey  represenf  fhe  major  workforce  in  fhis  program. 
Sfudenfs  are  selecfed  mainly  for  fheir  communicafion  skills,  and  sfudenfs  are 
given  a  stipend  for  working  30  hours  /  week. 
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3.  Outreach  Programs:  The  Perspective  from 
K-12  Classrooms 


This  section  addresses  the  first  research  question  of  our  sfudy,  abouf  fhe  impacfs 
and  challenges  of  oufreach  programs  for  differenf  parficipanfs  wifhin  K-12 
schools.  Since  fhis  research  is  nof  an  evaluafion,  buf  explorafory,  we  also  needed 
fo  discover  whaf  is  known  abouf  such  oufreach  programs,  characferizing  whaf 
fhey  do  and  idenfifying  fheir  impacfs.  The  issue  for  us  is  thus  ultimately  not  how 
well  the  program  is  meeting  the  purposes  for  which  if  was  esfablished  buf  whaf 
differences  fhe  program  has  made  in  fhe  feaching  of  science  in  K-12  classrooms, 
why  people  did  fhings  differenfly,  and  (when  possible)  whaf  specific  aspecf  of 
fhe  program  allowed  parficipanfs  fo  do  somefhing  differently. 

We  begin  by  describing  the  K-12  schools  and  communities  that  participated  in 
these  outreach  programs.  A  discussion  of  the  classroom  impacts  on  both  the 
teacher  and  the  K-12  students  follows.  Because  we  did  nof  inferview  fhe  K-12 
classroom  sfudenfs,  we  relied  on  fhe  feachers  fo  describe  fhe  impacfs  fhey 
observed  on  fheir  sfudenfs.  Our  discussion  of  impacfs  leads  fo  fhe  nexf  secfion, 
which  explores  fhe  challenges  fhese  programs  faced  in  fheir  efforfs  fo  enhance 
science  learning  in  fhese  schools.  We  conclude  wifh  some  fhoughfs  abouf  fhe 
implicafions  of  fhe  findings  reporfed  in  fhis  secfion. 


Outreach  Programs  and  K-12  Schools 

The  majorify  of  fhe  oufreach  programs  we  visited  partnered  with  public  schools 
in  urban  communities  and  used  direct  classroom  enhancement  and  teacher- 
preparation  approaches.  The  remaining  outreach  programs  worked  with  public 
schools  in  rural  areas  and  with  private  schools  in  suburban  areas.  These  outreach 
programs  used  the  teacher-researcher  and  remote  classroom  enhancement 
approaches.  It  was  difficult  to  estimate  the  number  and  types  of  schools  fhaf  used 
fhe  latter  approach  for  outreach.  Although  originally  designed  for  feachers  and 
sfudenfs  in  rural  communities,  Infernef  fechnology  makes  fhis  program 
accessible  fo  any  classroom. 

Schools  became  involved  in  fhe  oufreach  activities  by  a  variety  of  mefhods.  One 
of  fhe  largesf  programs  we  visifed  was  parf  of  a  disfricfwide  reform  efforf,  and 
all  fhe  disfricf's  schools  were  involved.  Ofher  oufreach  programs  chose  fo  work 
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with  a  small  set  of  schools  in  the  immediate  vicinity  of  the  university  and  to 
begin  developing  relationships  with  individual  teachers  in  the  schools  to  identify 
fheir  needs  and  explore  possibilities  for  oufreach.  Approaching  schools  af  fhe 
teacher  level  was  a  common  strategy  among  many  of  fhe  oufreach  programs.  For 
many  of  fhe  programs,  relationships  wifh  feachers  had  already  been  culfivafed 
fhrough  graduafe  schools  of  educafion.  In  facf,  mosf  of  fhe  universifies  had 
esfablished  relationships  with  the  schools  prior  to  seeking  support  for  oufreach 
programs.  Mosf  universifies  were  already  engaged  in  oufreach  acfivifies  and 
soughf  addifional  funding  fo  expand  fhe  scope  of  their  programs  or  to  explore 
another  dimension  of  oufreach.  A  few  of  fhe  programs  we  visifed  resulfed  from 
K-12  feachers  initiafing  confacf  wifh  fhe  universify.  In  fhese  insfances,  science 
teachers  who  were  aware  of  the  lack  of  science  resources  at  their  schools  made 
efforts  to  contact  and  work  with  science  faculty  to  develop  outreach  programs.  In 
these  programs,  K-12  science  teachers  and  committees  had  the  responsibility  of 
involving  more  schools  in  the  outreach  program. 


Classroom  Impacts:  Teachers 

K-12  classrooms  are  complex  environments.  Depending  on  the  school  type  and 
the  community,  teachers  have  to  contend  with  many  different  challenges  in  their 
efforts  to  enhance  science  instruction.  For  example,  many  of  fhe  K-12  classrooms 
in  urban  schools  faced  issues  relafed  fo  mofivafion  fo  learn,  limited  access  to 
resources,  district  policies,  and  other  issues  that  can  impede  classroom  learning. 
In  some  of  fhe  classrooms  in  rural  communities,  challenges  relafed  fo  English 
proficiency  and  fhe  necessary  schooling  skills  were  also  an  issue.  Whaf  effecf  do 
oufreach  programs  have  in  such  complex  and  challenging  environmenfs?  In  fhis 
subsection,  we  focus  specifically  on  fhe  impact  these  programs  had  on  teachers. 
Many  of  fhe  fhemes  highlighfed  here  are  based  on  commenfs  from  feacher 
inferviews.  As  shown  in  Table  3.1,  teachers  reported  three  main  impacts: 
increased  interaction  with  fellow  feachers,  more  time  spenf  on  science 
insfrucfion,  and  changes  in  feaching  pracfices  fhat  included  increased  ufilizafion 
of  feaching  fools  in  science  insfrucfion.  Each  of  these  impacts  is  significant  and 
may  potentially  lead  to  improvement  in  student  science  learning.  In  this 
subsection,  we  examine  each  of  these  impacts  individually,  discuss  its 
significance  and  define  fhe  specific  feafures  of  fhe  oufreach  program  fhaf 
accounfed  for  the  impact. 


22 


Table  3.1 

Program  Impacts  on  K-12  Teachers 


Impact 

Cause 

Potential  Outcomes 

Increased  collegiality 

Shared  experience  of 

Proactive  in  science 

among  teachers 

participating  in  outreach 

Community  building 

program 

Stronger  support  system 
among  teachers 

Build  leadership  capabilities 

Increased  time  on 

More  familiar  and  comfortable 

Develop  proficiency  in  science 

science  instruction 

with  science  as  a  discipline 
Support  and  weekly  presence 
of  university  science  students 
in  classroom 

teaching 

Utilized  more 

Access  to  resources  from 

Ability  to  craft  lesson  plans 

teaching  tools  in 

university 

more  appropriate  to  student 

science  instruction 

Improved  conceptual 
understanding  of  science. 
Observing  grad  and  undergrad 
students  with  K-12  students 

Increased  classroom 
manageability 

needs 

Increased  Collegiality  Among  Teachers 

Many  of  the  teachers  we  interviewed  found  the  increased  collegiality  and 
interaction  invaluable.  In  fact,  this  was  frequently  one  of  the  first  things 
mentioned  when  discussing  impacts  of  the  program.  From  urban  classrooms  to 
suburban  and  affluent  private  schools,  all  teachers  commented  on  increased 
collegiality  as  a  major  benefit  of  the  programs.  Most  of  the  programs,  through 
their  professional  development  component,  provided  time  for  teachers  to  discuss 
what  they  have  learned,  talk  about  different  aspects  of  teaching,  and  share 
information.  The  experience  changed  the  way  they  viewed  themselves  as 
teachers,  as  well  as  using  other  teachers  as  resources.  This  sharing  of  information 
among  teachers  assisted  with  community  building  and  many  teachers  felt  that 
this  collegiality  would  remain  with  them  long  after  the  programs  were  over. 

The  importance  of  this  collegiality  cannot  be  overstated.  Many  respondents 
described  K-12  classrooms  as  environments  in  which  teachers  carried  out  their 
daily  activities  without  much  discussion  or  collaboration  with  other  teachers.  As 
one  teacher  describes  the  isolation  in  teaching: 

It's  a  killer,  man  .  .  .  it's  one  of  the  worst  cultural  things  going  on,  because  it 
becomes  acceptable  to  many  of  the  teachers.  1  know  1  mle  my  roost  and 
anything  else  out  there  I'll  deal  with  if  1  have  to. 
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Breaking  down  the  classroom  isolation  and  fostering  interaction  among  teachers 
also  contributed  to  developing  the  culture  of  feachers  as  professionals.  Teachers 
were  offen  amazed  af  fhe  differences  inferacfions  made.  One  program 
coordinafor,  who  had  formerly  worked  as  an  elemenfary  school  feacher, 
explained  fo  us  fhaf 

teachers  don't  really  get  a  chance  to  get  out  of  the  classroom,  and  when 
they  get  out  and  interact  with  one  another,  it's  like  social  time  for  them. 

They  have  so  much  information,  and  if  you  give  them  a  chance  to  speak, 
they  have  so  much  to  offer!  They  simply  weren't  used  to  being  out  of  the 
classroom  and  treated  like  a  professional. 

We  wanted  to  find  ouf  how  oufreach  programs  confribufed  fo  fhis  increased 
collegialify  and  asked  feachers  fo  explain  fhis  impacf.  Mosf  feachers  sfafed  fhaf 
fhe  shared  experience  of  being  involved  in  fhe  oufreach  program  provided  fhem 
wifh  a  basis  for  communication  abouf  science  feaching  and  learning.  As  a  resulf 
of  fhis  experience,  some  feachers  reporfed  fhaf  fhey  have  become  more  proacfive 
abouf  efforfs  fo  improve  science  education  in  fheir  schools. 


Teachers  Spend  More  Time  on  Science  Instruction 

All  fhe  feachers  we  inferviewed  sfafed  fhaf  fhey  spenf  more  fime  on  science 
insfrucfion  as  a  resulf  of  parficipafing  in  fhe  oufreach  program.  This  impacf  is 
particularly  significanf  because  conversations  wifh  feachers  indicafed  fhaf  in 
many  schools  science  receives  very  little  attention,  if  any  af  all.  One  of  fhe  more 
common  reasons  for  fhis  was  fhe  limifed  school  budgef  for  purchasing  science 
maferials: 

A  lot  of  teachers  didn't  do  science  before  [program  x]  because  the  school 
wouldn't  provide  money  for  resources.  Science  gets  put  on  the  back 
burner,  and  not  having  materials  makes  it  easy  to  push  back. 

At  the  elementary  grade  levels,  science  received  little  attention  because  many 
school  districts  do  not  have  standardized  tests  in  science  prior  to  5th  grade. 
Consequently,  there  are  few  incenfives  for  feaching  science  af  fhe  elemenfary 
grade  levels.  One  program  director  we  spoke  fo  referred  fo  fhis  as  a  crisis: 

I  can  tell  you  that,  nationwide,  science  is  not  really  being  taught.  And  right 
now  we  are  in  a  crisis  period  because  there  is  a  big  shift  to  language 
acquisition,  and  many  of  our  states  are  trying  not  to  teach  science  at  all 
until  the  5th  grade,  not  even  pretend  to. 

Teachers  and  the  graduate  students  involved  in  direct  classroom  support  also 
shared  similar  comments  about  the  lack  of  science  insfrucfion  in  elemenfary 
grade  levels: 
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I  know  in  elementary  school  it's  different  from  high  school  where  they 
actually  change  classes.  So  a  teacher  in  elementary  school,  if  one  day  they 
didn't  feel  the  need  to  do  science,  they  could  just  skip  it.  But  by  having  us 
[graduate  and  undergrad  students],  on  that  particular  day  the  students  are 
guaranteed  to  have  their  science  lecture. 

When  you  look  at  the  elementary  school  levels,  when  children  do  not  have 
the  inquiry  experience,  they  lag  behind  in  the  upper  level.  Many  times  I've 
heard  middle  and  high  school  teachers  talk  about  the  gap  in  science 
education  and  it  really  can  take  place  in  elementary  education. 

In  addition  to  lacking  resources  for  science  instruction  and  having  few  exfernal 
incentives  for  feaching  science,  simply  nof  being  comforfable  wifh  fhe  scientific 
subjecf  maffer  also  made  if  easy  fo  spend  less  time  on  science  fhan  on  ofher 
subjecfs.  Wifh  such  sfrong  disincenfives  for  feaching  science,  if  is  imporfanf  fhaf 
feachers  be  comforfable  wifh  fhe  subjecf  maffer  and  understand  and  appreciate 
the  importance  of  teaching  science.  Consequently,  one  of  fhe  imporfanf  aspecfs  of 
fhe  oufreach  programs  was  fhe  focus  on  changing  teachers'  attitudes  toward 
science  through  professional  developmenf  activities  designed  fo  increase  science 
confenf  knowledge.  Many  of  fhe  program  direcfors  we  spoke  wifh  acknowledged 
fhe  imporfance  of  getting  feachers  more  comforfable  wifh  teaching  science: 

Having  the  teachers  know  more  science  content  is  a  big  piece  because  so 
many  elementary  teachers  have  not  been  provided  with  the  science  content 
and  the  accompanying  pedagogy  for  teaching  science.  They  don't  have  the 
science  content  background,  and  it's  been  very  scary  for  the  teachers.  So 
they  put  the  science  last  or  put  it  to  the  side.  So  this  program  has  made  the 
teachers  more  comfortable  and  able  to  teach  it  more  effectively. 

Teachers  were  very  fearful  of  any  kind  of  science.  Before  you  could  get  into 
any  kind  of  mechanics,  you  have  to  address  the  concerns  that  teachers  had 
regarding  their  fears.  Give  icebreaker  activities,  demonstrate  that 
everything  is  science,  e.g.,  soaking  up  water  with  sponge-saturation,  etc. 

In  programs  where  graduate  students  provided  classroom  support,  observing 
and  working  with  them  in  the  classroom  helped  teachers  feel  comfortable  and 
more  at  ease  with  teaching  science: 

At  first  teachers  admitted  they  didn't  like  science,  they  were  afraid  to  teach 
it,  but  when  they  saw  the  college  students  in  the  classroom  doing  it,  they 
began  to  enjoy  it  themselves.  There  is  still  some  resistance  out  there,  but 
there  is  still  some  evidence  that  shows  that  there  is  more  science  teaching. 
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Instructional  Practices  Include  More  Hands-On,  Investigative 
Learning 

Perhaps  the  largest  reported  impact  of  all  was  in  the  area  of  feaching  practice.  As 
sfafed  in  Section  2,  fhe  goals  of  all  of  fhe  programs  included  enhancing  science 
insfrucfion,  which  usually  mean!  promoting  fhe  use  of  hands-on  insfrucfional 
pracfices  in  fhe  classroom.  Thus,  as  a  resulf  of  parficipafing  in  fhe  programs,  all 
feachers  said  fhey  used  more  projecf -based  and  investigational  learning 
fechniques  fo  explain  scientific  concepfs: 

The  inquiry  method  is  a  method  that  really  lends  itself  to  helping  children 
build  ideas  based  on  discovery.  It's  a  great  skill  to  use  in  all  the  subject 
areas.  And  I  find  that,  personally,  I  use  it  more,  the  questioning  technique 
more,  instead  of  the  traditional  method  of  giving  more  information. 

Before,  I  taught  genetics  using  the  paper  and  pencil  model.  Now  I 
incorporate  plants  in  the  classroom;  we  do  hands  on;  the  students  keep  a 
journal;  and  changes  in  curriculum  are  based  on  conversations  about  what 
was  successful  and  what  worked.  In  addition,  the  kids  have  fun! 

For  fhe  mosf  part,  teachers  welcomed  the  use  of  differenf  feaching  approaches  in 
fhe  classroom.  Teachers  acknowledged  feeling  limifed  by  using  only  fradifional, 
fexfbook-based  feaching  pracfices.  Yef,  prior  fo  parficipafing  in  oufreach 
programs,  many  feachers  felf  fhey  did  have  fhe  fools  af  fheir  disposal  fo  change 
feaching  practice.  The  opporfunify  fo  use  new  mefhods  fhaf  included  curriculum 
maferials  developed  specifically  for  inquiry -based  approaches  fo  feaching  science 
was  very  appealing  fo  feachers: 

The  information  they  introduced  to  us  was  so  exciting  because  it  touched 
something  in  me  as  a  teacher.  I  never  thought  I  could  make  such  an  impact 
on  the  students.  I  always  knew  that  the  children  loved  the  hands-on 
approach.  They  love  to  be  involved.  So  learning  how  to  implement  this 
formally  was  great!  It  really  gave  me  an  excitement  that  I  could  see  myself 
going  back  into  the  classroom  and  sharing  this  with  the  students. 

Some  of  fhe  graduafe  sfudenfs  we  inferviewed  also  commenfed  on  fhe  change  in 
feaching  pracfices: 

Before  I  came,  the  teacher  was  teaching  very  discontinuously  and  teaching 
to  the  test.  Once  we  started  working  together,  she  cared  less  about  SAT-9 
and  felt  that  the  kids  were  now  getting  more  out  of  the  curriculum  with  a 
continuous  structure. 

Having  the  needed  materials  was  certainly  an  important  part  of  changing 
feaching  pracfices  for  many  feachers;  however,  having  graduafe  and 
undergraduafe  science  sfudenfs  in  fhe  classroom  fo  supporf  these  changes  made 
the  difference  befween  feachers  undersfanding  fhe  imporfance  of  hands-on 
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teaching  methods  and  actually  implementing  these  practices  in  the  classroom  on 
a  consistent  basis.  As  one  teacher  explained. 

Having  access  to  resources,  these  are  the  kinds  of  things  that  you  cannot 
put  a  price  tag  on.  However,  unless  you  know  how  to  use  the  devices,  and 
unless  you  feel  safe  that,  if  you  make  a  mistake,  there  is  someone  who  can 
help  you,  you  are  not  going  to  use  the  equipment. 

Many  of  the  teachers'  comments  suggest  that  the  graduate  students  served  as 
catalysts  for  changing  feaching  pracfices  in  fhe  classroom.  The  oufreach 
programs  were  already  infusing  fhe  schools  wifh  resources  and  professional 
developmenf  opporfunifies  for  fhe  feachers  and  building  fhe  infrasfrucfure  for 
long-term  sustainable  change.  However,  as  true  catalysts,  the  graduate  students 
were  able  to  expedite  a  process  that  might  have  occurred  on  its  own  but  might 
have  taken  much  longer. 


Graduate  and  Undergraduate  Students  Support  Changes  in 
Teacher  Practices  in  a  Variety  of  Ways 

The  specific  ways  in  which  fhe  graduafe  sfudenfs  supporfed  feachers  in  fheir 
efforfs  fo  change  feaching  pracfices  depended  primarily  on  fhe  program 
approach.  For  example,  in  remofe  classroom  enhancemenf  programs,  graduafe 
sfudenfs  provided  science  confenf  fo  supporf  fhe  feachers  and  sfudenfs  so  fhaf 
classroom  lessons  would  nof  necessarily  be  limifed  fo  fhe  feacher's  knowledge.  In 
fhis  way,  feachers  could  engage  in  more  creafive  lesson  plans  wifhouf  being 
concerned  abouf  fheir  abilify  fo  answer  fechnically  difficulf  quesfions: 

I  use  this  [program  x]  for  questions  that  come  up  from  kids  that  would  be 
better  answered  by  experts  than  by  myself.  I  am  using  it  as  a  resource  for 
information  rather  than  as  a  teaching  tool.  However,  it  is  my  plan  to 
include  it  this  year  as  a  teaching  element,  to  help  students  to  think  more 
about  the  process  of  formulating  questions. 

As  developers  of  insfrucfional  maferials,  feachers  reported  that  the  role  graduate 
and  undergraduate  students  played  in  building  and  maintaining  science  kits  for 
K-12  classrooms  was  a  key  parf  of  changing  feaching  pracfice.  In  one  program, 
undergraduafe  sfudenfs  design,  build,  and  mainfain  circuif  boards  for  physics 
insfrucfion.  They  also  work  wifh  fhe  program  direcfor  fo  develop  a  worksheef  fo 
guide  fhe  curriculum.  The  convenience  of  having  fhe  boards  designed  and 
managed  by  fhe  sfudenfs  meanf  fhaf  feachers  were  more  likely  fo  use  fhese  kifs 
in  fheir  insfrucfion.  Moreover,  having  access  fo  resources  fhaf  are  nof  commonly 
available  fo  feachers  played  an  imporfanf  role  in  changing  feaching  pracfice: 

If  something  breaks  down  I  can  e-mail  them  and  say  this  unit  does  not 
work  because  I  need  this  part,  and  they  will  mail  it  to  me.  Because  of  a 
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limited  budget,  this  would  be  difficult  for  me  to  do  otherwise.  From  a 
budgeting  standpoint,  I  can  never  get  ahead  to  buy  something  new;  here, 
there's  no  cost. 

So  here  again,  the  program  not  only  provides  teachers  with  the  resource  (in  this 
case,  circuit  boards)  to  change  teaching  practice  but  also  providing  them  with  the 
means  to  support  using  the  additional  resources  (e.g.,  undergraduate  students). 

In  teacher-researcher  programs,  we  found  a  similar  pattern.  These  summer 
programs  focused  on  giving  feachers  an  undersfanding  of  fhe  scienfific  process 
so  fhaf  fhey  would  be  more  adepf  af  feaching  fhe  hands-on  inquiry  model  in  fhe 
fall.  Additionally,  fhe  feachers  also  received  kifs  and  were  shown  differenf 
fechniques  fhaf  fhey  could  take  back  with  them  to  the  classroom.  Here,  one  of  fhe 
major  impacfs  fhe  graduafe  sfudenfs  had  on  changing  feaching  practice  was  fhe 
facf  fhaf  fhey  remained  a  resource  for  fhe  feacher  long  affer  fhe  completion  of  fhe 
program,  answering  questions  and  helping  wifh  fhe  classroom  maferials. 

By  design,  direcf  classroom  enhancemenf  programs  gave  science  sfudenfs  fhe 
greafesf  opporfunify  fo  supporf  feachers  in  fheir  efforfs  fo  change  feaching 
pracfices.  For  some  feachers  we  inferviewed,  feaching  pracfices  were  closely 
linked  fo  classroom  managemenf  issues,  and  science  sfudenfs  in  fhe  classroom 
were  an  imporfanf  resource  for  keeping  fhe  sfudenf-fo-feacher  ratio  low  enough 
fo  allow  effective  hands-on  learning: 

The  smaller  student-teacher  ratio  is  the  key.  With  another  graduate  or 
undergraduate  student  in  the  classroom,  the  ratio  is  15  to  1.  Also,  the 
additional  knowledge  base  of  the  students  helps.  Smaller  groups,  small 
class  sizes,  means  the  quality  of  interaction  with  the  K-12  students 
increases. 

The  student  behavior  is  out  of  hand,  and  the  scores  don't  improve.  Smaller 
class  size  is  directly  related  to  better  grades.  Having  more  than  one  person 
in  the  classroom  helps  the  supervision  and  makes  the  student-teacher  ratio 
smaller. 

The  importance  of  having  a  smaller  sfudent-fo-feacher  ratio  for  hands-on 
learning  was  apparenf  fo  fhe  graduafe  sfudenfs  as  well.  When  asked  abouf 
recommendations  for  improving  fhese  programs,  many  graduafe  sfudenfs 
suggesfed  fhe  number  of  universify  sfudenfs  coming  fo  fhe  classrooms  be 
increased  because  too  often  "fhe  K-12  sfudenfs  don'f  gef  enough  attention." 

Many  of  fhe  commenfs  from  fhis  secfion  suggesf  fhaf  affempfs  fo  change  feacher 
pracfice  wifhouf  a  clear  undersfanding  of  fhe  necessary  supporf  mechanisms  are 
bound  fo  be  shorf  lived.  Many  feachers  commented  fhaf  mandafes  for  changing 
feacher  pracfice  in  science  education  were  unrealisfic  because  fhey  reflected  a 
lack  of  undersfanding  about  classroom  environments  in  today's  schools.  And 
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although  many  teachers  agreed  that  most  of  these  reforms  were  pedagogically 
sound  and  would  perhaps  improve  science  learning,  fhese  reforms  were  virfually 
impossible  fo  carry  ouf  in  a  real  world  classroom  environmenf.  The  feafure  thaf 
feachers  liked  and  appreciafed  mosf  about  the  outreach  programs  is  that,  in 
addition  to  showing  them  how  to  change  teaching  practices  and  giving  them  the 
necessary  information  to  change  teaching  practice,  the  programs  directly 
supported  teachers'  efforts  to  change  teaching  practice. 


Classroom  Impacts:  K-12  Students 

The  impact  of  fhese  programs  on  K-12  sfudenfs  was  much  more  difficulf  fo 
gauge.  We  did  nof  inferview  K-12  sfudenfs,  so  we  relied  on  feachers'  and 
program  direcfors'  commenfs  fo  defermine  the  impacts  these  programs  had  on 
the  students.  As  shown  in  Table  3.2,  three  main  impacts  were  commonly  cited: 
students  showed  increased  enthusiasm  for  and  inferesf  in  science;  fhe  abilify  fo 
engage  different  levels  of  sfudenfs  in  science  acfivities  increased;  and  awareness 
of  uni  versify  culfure  increased.  Commenfs  from  the  previous  section  suggest  that 
many  of  fhe  impacfs  were  probably  due  fo  the  changes  in  teaching  practice  the 
outreach  programs  promoted.  However,  as  we  will  see  next,  science  students 
contributed  to  these  impacts  in  an  important  way  by  serving  as  role  models  and 
mentors  and  by  providing  tangible  examples  of  scienfisfs  for  many  sfudenfs. 


Students  Demonstrate  Increased  Enthusiasm  for  and  Interest  in 
Science 

The  inferest  and  the  enthusiasm  that  students  display  toward  science  was  one  of 
fhe  mosf  cifed  impacfs  fhaf  the  teachers  reported.  This  impact  seemed  to  be 
particularly  significant  in  urban  schools,  where  getting  kids  motivated  to  learn 
can  be  a  challenge: 

The  pedagogy  is  one  that  excites  African-American  children.  In  general, 
research  shows  that  African-American  kids  have  more  interest  if  taught  in 
a  hands-on  way  and  done  with  collaborative  learning.  You  get  kids  who 
come  to  school  without  the  specific  vocabulary  words  but  can  experience 
success.  Teachers  have  told  us  that  the  slowest  reader  in  the  class  can  be 
the  first  to  get  the  light  bulb  to  light  up. 

The  grades  don't  reflect  it.  But  it  does  put  science  in  a  positive  light;  science 
is  now  seen  as  fun;  there  is  more  interest  and  the  kids  look  forward  to 
doing  it.  It  hasn't  improved  standardized  test  scores;  however,  I  would  not 
give  up  on  the  program.  Working  with  at-risk  kids;  kids  lack  the 
motivation,  and  this  is  a  challenge. 
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Table  3.2 

Program  Impacts  on  K-12  Students 


Impact 

Cause 

Potential  outcomes 

Increased  enthusiasm 
and  interest  in 
science 

Hands-on  pedagogy 
Interaction  with  graduate 
and  undergraduate  science 
students 

Enhanced  science  learning 

Increased  levels  of 
student  engagement 
in  science  activities 

Hands-on  pedagogy 

Smaller  classes 

Enhanced  science  learning 

Increased  awareness 

Interaction  with  graduate 

Increased  awareness  of 

of  university  culture 

and  undergraduate  science 
students 

different  educational 
opportunities 

Students  at  All  Levels  Are  Engaged  in  Science  Activities 

Teachers  felt  strongly  that  the  ability  to  engage  all  of  their  students  in  the 
learning  process  was  an  important  classroom  impact.  The  hands-on  teaching 
practices  promoted  by  the  outreach  programs  gave  students  an  opportunity  to 
explore  learning  for  themselves.  More  importantly  though,  these  practices 
allowed  all  students  to  gain  something  from  the  learning  experience.  Despite  the 
different  learning  levels  in  a  classroom,  students  at  all  levels  had  the  opportunity 
to  be  fully  engaged  in  the  science  learning  process: 

For  the  higher-level  students,  they  enjoy  the  hands  on  but  they  would 
succeed  either  way.  It's  the  middle-  and  lower-level  students  that  are 
benefiting  from  the  hands  on  because  they  are  a  different  type  of  learner — 
maybe  they  are  a  kinesthetic  learner.  By  doing  hands  on,  first  of  all,  they 
are  going  slower,  so  they  are  able  to  absorb  the  information  and  become  an 
active  learner  and  do  their  own  exploration.  But  also,  the  real  low-level 
learners  are  actually  doing  something.  They  are  not  lost,  they  are  actually 
engaged. 

It's  a  hands-on  program,  which  can  be  a  minds-off  program.  Simply 
manipulating  doesn't  mean  you  understand,  but  it  does  give  children 
concrete  objects,  and  we  know  from  cognitive  research  that  the  need  for  the 
physical  is  so  imperative,  and  so  they  are  experiencing  and  working  with 
the  physical  as  they  work  with  more  abstract  issues. 

Students  like  it  because  they  can  see  something  tangible.  They  can  explore 
this  and  come  to  an  answer.  Even  if  they  are  not  getting  the  concepts,  they 
can  see  a  result  and  actually  I  find  that  my  worst  students  are  the  first  ones 
to  the  get  the  lights  to  go  on  and  the  buzzer  to  go  off.  So  there's  a  shift  of 
which  students  are  finding  success  first,  which  I  think  helps  a  lot  of  the 
students. 
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These  comments  reflect  what  many  teachers  felt  was  an  important  component  of 
fhe  hands-on  pracfices:  providing  a  mulfidimensional  aspecf  fo  learning  science 
such  fhaf  sfudenfs  wifh  differenf  learning  sfyles  could  parficipafe  in  fhe 
classroom  acfivifies.  Moreover,  mosf  feachers  fell  fhaf  fhey  sfill  had  considerable 
freedom  fo  failor  fhe  insfrucfion  fo  fif  fhe  level  of  fhe  mosf  of  fhe  sfudenfs: 

Your  students  may  not  have  the  vocabulary  for  the  kit  right  away  so  that 
may  be  a  group  that  I  may  have  to  do  a  little  bit  more  textbook  first.  We 
can  at  least  build  vocabulary  because  if  I'm  talking  about  glucose  you  need 
to  know  what  glucose  is,  so  that  I  can  bring  in  the  kit  after  I  introduce  it.  So 
it  just  depends  on  your  students.  With  my  students,  I  really  like  to  do  the 
vocabulary  first  and  then  come  back  and  reinforce  the  kits. 

Children  can  really  do  inquiry  and  gain  understanding  with  each  concept 
as  it  builds  on  to  itself.  Then  what  I  find  to  be  beneficial  after  the  kits  is  to 
do  more  paper  and  pencil  work  on  that  same  topic  because  then  they  have 
the  conceptual  framework  that  they  have  built  from  experience  with 
materials  and  with  concepts  and  understanding  and  investigating  on  their 
own,  so  that  the  information  will  become  more  of  their  own.  Then  I 
wouldn't  want  to  leave  it  there  because  we  are  a  testing  society,  plus  they 
really  need  to  be  able  to  build  on  the  information  that  they  have  using 
books,  Internet,  and  technology. 

Teachers  however,  also  acknowledged  that  engaging  students  was  not  enough. 
Increasing  student  motivation  about  science,  while  crucial,  is  still  just  the  first 
step.  More  has  to  be  done  to  translate  these  impacts  into  measurable  gains  on 
student  achievement  tests: 

I  think  the  program  enhances  science  learning.  But  we  have  to  move  to 
another  level.  For  example,  the  teacher  will  say  the  kids  are  excited  about 
the  science,  but  I  gave  him  a  test,  and  he  failed.  Well,  he  probably  failed 
because  he  couldn't  read  well.  So,  we  have  to  make  improvements  in  the 
teaching  to  leave  the  content  in.  I  still  think  we  have  a  ways  to  go  with  our 
teacher  training  and  getting  our  students  to  carry  the  lesson  beyond  the 
classroom. 


Many  o/  the  Impacts  Are  Enhanced  by  Interactions  with  Graduate 
and  Undergraduate  Students 

Although  many  of  fhe  impacfs  fhaf  fhe  feachers  describe  appear  fo  be  due  fo 
changes  in  feaching  pracfice,  if  was  clear  fhaf  fhe  inferacfion  wifh  graduafe 
sfudenfs  made  a  significanf  impact  on  the  students  as  well.  For  example,  despite 
differences  in  program  approach,  many  feachers  reporfed  fhaf  fheir  sfudenfs 
worked  much  harder  af  fheir  classroom  fasks  and  really  wanfed  fo  impress  fhe 
graduafe  and  undergraduafe  sfudenfs: 
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When  they  know  that  the  audience  is  not  the  teacher,  even  if  it's  going  on  a 
Web  page  that  may  show  up  on  the  Internet,  they  will  stop  and  try  to  spell 
it  right  or  try  and  make  it  sound  better,  whereas  they  will  turn  in  any  junk 
to  the  teacher. 

The  impact  of  having  someone  else  involved  with  the  classroom  was  difficult  to 
describe,  yet  teachers  and  program  directors  alike  were  aware  of  this  added 
dimension: 

It's  not  only  the  pedagogy,  but  it's  the  college  students  as  well  who  go  in 
and  the  impact  of  the  college  student  is  one  that  is  intangible,  but  you  see 
how  the  elementary  kids  light  up  when  the  college  students  come  into  the 
classroom. 

Certainly  one  aspect  of  this  impact  was  that,  for  many  of  the  K-12  students,  the 
undergraduate  and  graduate  students  were  seen  as  role  models: 

The  college  age  students  are  close  to  being  big  brothers  and  sisters  to  the 
kids,  so  that  it  provides  a  beautiful  exchange  for  the  students,  and  many  of 
them  grow  close  to  the  science  students.  Especially  when  they  start  out  as 
freshman,  they  follow  the  students.  In  an  urban  environment,  that's  really 
important,  the  role-model  link. 

Having  someone  in  college  going  to  teach  elementary  school — ^when  I  first 
went  in  they  were  like  "Wow!  You're  in  college!"  They  thought  it  was  so 
incredible. 

The  students  were  able  to  take  the  lesson  a  step  further  in  terms  of  their 
knowledge.  They  were  also  role  models.  My  kids  weren't  science  oriented, 
so  the  science  students  were  like  role  models.  The  kids  would  jump  for  joy 
when  they  came  in  the  classroom. 

Overall,  the  students  displayed  more  interest  in  science  and  science  careers  as  a 
result  of  interacting  with  the  graduate  and  undergraduate  students.  This  was 
also  linked  to  a  greater  awareness  of  the  possibility  of  attending  a  college  or 
university,  which  may  have  been  outside  of  their  intended  goals.  As  one 
program  director  explained: 

We've  done  some  classes  where  the  high  school  kids  mix  with  the 
university  kids.  And  the  high  school  students  see  that  it's  not  impossible 
that  they  might  come  here.  They  think  they  may  go  to  a  community 
college,  but  they  come  and  they  see  that  it's  hard  but  not  impossible,  and 
they  begin  to  see  that  these  people  are  not  much  different  than  them. 


Impacts  on  Improved  Science  Learning  Are  Difficult  to  Measure 

Given  the  list  of  impacts  discussed  in  the  previous  sections,  were  teachers  and 
program  directors  able  to  see  any  of  the  potential  outcomes  listed  in  Table  3.1? 
Only  a  few  of  the  teachers  and  program  directors  we  interviewed  could  point  to 
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any  measurable  changes  in  test  scores  or  grades  to  demonstrate  increased  science 
learning.  However,  both  groups  of  interviewees  were  convinced  that  the 
students  benefited  tremendously  from  fhese  programs,  parficularly  from  fhe 
changes  in  feaching  pracfice  fhaf  these  programs  produced.  Yet,  the  evidence  for 
improved  learning  was  largely  anecdofal.  When  asked  specifically  fo  poinf  fo 
evidence  fhat  would  subsfanfiafe  fhe  claim  of  improved  sfudenf  learning,  mosf 
feachers  reporfed  fhaf  sfudenfs  were  able  fo  recall  and  remember  defails  from 
science  experimenfs.  Program  directors  were  a  bif  more  caufious  in  fheir 
sfafemenfs  and  confrasfed  if  wifh  fhe  sifuafion  prior  fo  outreach: 

I  know  that  even  if  the  kits  are  not  being  used  as  we  hoped  them  to  and  if 
the  teachers  aren't  as  wonderful  as  we  would  like,  no  matter  what 
negatives  we  might  put  on  it,  it  is  better  than  what  was  happening  four 
years  ago.  I  know  that  all  of  what  goes  on  in  the  classrooms  is  not 
superlative,  but  I  know  it  is  better  than  what  was  going  on  before  this 
program. 

For  many  that  we  spoke  to,  this  seemed  to  be  an  all-too-common  dilemma  of 
oufreach  programs — fhe  "we  know  if's  a  good  fhing,  buf  how  do  we  show  if?" 
syndrome.  There  were  fwo  main  responses  fo  fhe  quesfion  of  why  programs 
were  unable  fo  demonsfrafe  quanfitafive  evidence  of  improved  science  learning. 
The  firsf  reason  had  fo  do  wifh  time.  Commenfs  from  program  directors  and 
coordinators  reflecfed  fhe  view  fhat  expecting  to  see  student  achievement  gains 
in  less  than  five  years  is  unrealistic,  parficularly  when  only  a  few  of  fhe  variables 
(e.g.,  professional  developmenf  of  feachers)  relafed  fo  low  sfudenf  achievemenf 
in  science  have  been  attended  fo: 

There's  a  long  time  lag  between  implementation  of  a  program  and  a 
measurable  student  outcome,  and  so  this  time  window  has  been  too  short. 
Implementation  of  a  program  that's  primarily  focused  on  professional 
development  for  teachers  is  a  necessary  condition  for  student  achievement, 
but  I  don't  think  it's  a  sufficient  condition  for  school  achievement.  So  I 
think  we  would  be  remiss  if  we  say  that  this  particular  effort  is  going  to 
have  a  marked  difference  in  student  achievement  if  we  don't  attend  to  the 
other  factors  underlying  the  causes  of  low  student  achievement  to  begin 
with. 

Change  is  not  immediate.  This  was  not  designed  as  a  research  program, 
but  as  an  intervention,  a  more  ephemeral,  Byzantine  process. 

The  second  reason  that  was  often  given  had  to  do  with  limited  budgets  that  did 
not  allow  an  opportunity  to  plan  evaluations  that  could  inform  direcfors  and 
coordinators  on  how  besf  fo  refine  programs  in  ways  fhaf  mighf  lead  fo 
improvemenfs  in  sfudenf  achievemenf: 

What  I  have  been  able  to  perceive  as  a  flaw  in  our  design  is  that  we  have 
not  been  able  to  do  the  plan,  do,  check,  and  act  cycle.  We've  been  doing  a 
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lot  of  planning  and  a  lot  of  doing,  but  we've  not  been  given  the 
opportunity,  either  because  at  first  we  weren't  allowed  to  go  into  the 
schools,  or  later  when  the  program  was  too  big,  we  didn't  have  the  people 
to  really  be  in  the  schools  and  know  what's  happening.  So,  we  had  to  go  on 
faith  or  on  what  we  heard,  but  we  didn't  really  have  that  information  that 
we  wished  we  now  had. 


Challenges  Faced  by  K-12  Schools  and  Communities 

An  important  piece  of  this  discussion  on  impacts  is  an  understanding  of  fhe 
challenges  oufreach  programs  faced  in  fheir  efforfs  fo  improve  science  learning. 
In  fhe  absence  of  undersfanding  fhe  challenges,  if  is  difficulf  fo  puf  fhe  impacfs 
lisfed  in  fhe  previous  secfions  in  perspecfive.  We  asked  program  parficipanfs  fo 
commenf  on  fhe  challenges  fhey  experienced  parficipafing  in  oufreach  programs, 
In  fhis  secfion,  we  lisf  fhose  challenges  fhaf  were  based  on  policies  or  pracfices 
relafed  fo  K-12  schools. 


Outreach  Programs  Targeting  Schools  in  Underserved 
Communities  Face  Unique  Challenges 

Clearly,  fhe  biggesf  challenges  for  oufreach  programs  in  urban  schools  were 
issues  surrounding  fhe  mofivafion  fo  learn.  Teachers  and  program  directors  alike 
all  commenfed  on  fhe  difficulfies  associafed  wifh  esfablishing  oufreach  programs 
in  schools  where  improving  science  learning  was  offen  losf  amidsf  deeper 
classroom  challenges: 

There  are  many  kids  coming  into  the  public  school  systems  today  that 
don't  have  a  desire  to  learn,  and  I  don't  care  what  kind  of  content  you  put 
in  front  of  them,  if  you  don't  deal  with  that  issue  you're  not  going  to  make 
the  impact  you  are  trying  to  make. 

You  are  dealing  with  these  poor  kids  who  have  no  real  interest  in 
education,  and  you've  got  to  do  something  to  get  them  interested.  If  I  were 
a  teacher  in  that  setting,  my  enthusiasm  would  drop  off  exponentially.  The 
environment  is  very  difficult. 

Programs  doing  outreach  to  schools  in  rural  communities  faced  additional 
challenges  in  efforts  to  enhance  science  instruction.  In  these  schools,  the  student 
population  is  highly  transient,  and  a  number  of  the  students  come  from  migrant 
families.  One  teacher  commented  on  his  class: 


I  have  a  fair  amount  of  ESL  {English  as  a  Second  Language]  kids  that  have 
the  motivation  but  not  the  English  skills,  in  some  cases  not  the  schooling 
skills,  having  come  from  farmworking. 
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These  comments  highlight  why  teachers  were  so  encouraged  by  what  they  saw 
occurring  in  the  classroom  as  a  result  of  these  outreach  programs.  Here  you  have 
schools  with  students  that  are  not  interested  in  being  in  class,  perhaps  with 
insufficient  skills  to  be  in  class,  and  yet  according  to  the  teachers,  they  are  much 
more  engaged  and  excited  about  learning  science.  These  comments  are  also 
important  in  considering  the  ability  of  evaluation  fo  measure  all  fhe  dimensions 
of  oufreach  programs  and  fhe  ways  fhey  impacf  sfudenf  learning. 

Ofher  challenges  were  relafed  fo  how  fhe  expertise  of  graduafe  and 
undergraduafe  sfudenfs  was  ufilized  in  fhe  classroom.  Rafher  fhan  being  confenf 
resources,  some  graduafe  sfudenfs  were  expecfed  fo  do  mosf  of  fhe  feaching,  or 
in  ofher  insfances,  fhey  served  primarily  as  exfra  sefs  of  hands  fo  aid  feachers  in 
seffing  up  science  equipmenf.  One  program  coordinator  nofed  fhaf,  in  some 
classrooms,  feachers  allow  fhe  sfudenfs  fo  do  mosf  of  fhe  feaching: 

A  lot  of  teachers  go  limp  in  the  classroom  and  just  let  the  science  students 
take  over.  The  teachers  see  this  as  cognitive  checkout  time.  This  is  what  we 
were  afraid  of,  that  the  teachers  would  see  this  as  free  time  and  would 
expect  our  students  to  come  in  and  do  it  for  them. 

Frankly,  I  think  one  of  the  biggest  things  this  program  has  done  is  provide 
an  extra  set  of  hands  and  brains.  The  original  model  was  that  somehow 
these  undergraduates  would  be  a  resource  of  information  somehow,  and 
it's  not  that  way.  They  are  resources  for  dealing  with  classroom,  helping  to 
prepare  materials,  testing  out  labs,  etc.  The  original  model  is  not  what  is 
happening  at  all. 

These  examples  suggest  that  achieving  a  balance  between  teacher  needs  and 
university  ideas  of  whaf  feachers  need  is  difficulf.  These  parfnerships  are 
importanf  because  fhey  offer  fhe  opporfunify  fo  infuse  classrooms  wifh  ideas  and 
resources  fhaf  may  nof  be  available  ofherwise.  However,  if  fhese  ideas  and 
resources  are  nof  meefing  fhe  real  'Teacher  needs,"  programs  like  fhis  run  fhe 
risk  of  having  fheir  resources  used  ouf  of  confexf.  The  previous  examples  suggesf 
fhaf  fhe  real  feacher  need  may  be  smaller  classes,  nof  necessarily  confenf  experfs 
in  fhe  classroom.  In  fhis  sifuafion,  if  is  highly  likely  fhaf  fhe  universify  sfudenf 
who  works  in  fhe  classroom  may  primarily  work  in  a  feachers  aide  capacify. 
Similarly,  if  a  feacher  feels  fhaf  his  or  her  background  in  science  is  inadequafe  fo 
teach  cerfain  fopics,  if  is  likely  fhaf  a  graduafe  sfudenf  will  be  asked  fo  do  much 
of  fhe  classroom  feaching. 
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District  Policies  That  Focus  on  Improving  Math  and  Reading  Skills 
Leave  Little  Time  for  Science 

All  of  the  schools  reported  district  policies  as  one  of  major  challenges  they  faced 
in  participating  in  science  outreach  programs.  Most  teachers  and  program 
directors  felt  that  district  policies  were  often  in  conflict  with  the  goals  of  the 
outreach  program.  For  some  schools,  the  district's  focus  on  improving  test  scores 
meant  devoting  more  classroom  time  to  improving  math  and  reading  skills, 
which  left  little  time  for  science: 

The  new  superintendent  has  said  we  have  children  who  cannot  read  at 
grade  level,  and  that  will  be  our  focus.  So  teachers  are  saying  "You  have  to 
do  3  hours  of  reading,  do  some  math,  and  that's  it  for  the  day."  So  if  the 
kids  just  do  reading  and  math,  then  there's  not  likely  to  be  an  increase  in 
their  science  achievement. 

So  much  time  is  spent  in  reading,  and  maybe  they  do  science  once  a  week. 
Reading  is  the  priority.  I  think  many  people  are  afraid  of  the  science 
because  it  is  such  an  unknown. 

Moreover,  many  of  the  comments  revealed  that  during  "test  time"  very  little 
time,  if  any,  is  spent  on  science  instruction,  in  preparation  for  standardized  tests, 
school  instruction  focuses  almost  entirely  on  math  and  reading,  and  it  is  difficult 
to  maintain  the  consistency  of  science  instruction  that  had  been  built  up  over  the 
months: 

All  instmction  stops  in  Febmary,  and  it's  skill  and  drill,  practice  for  test  all 
day  long.  It  doesn't  necessarily  mean  that  they  are  going  to  do  any  better. 

So  the  focus  is  on  math  and  reading.  And  only  at  a  few  grade  levels  is 
science  tested.  So  it's  at  those  grade  levels  that  the  teachers  focus  more  on 
science,  but  it's  a  problem  because  it  is  supposed  to  be  a  cumulative  test 
and  so  you  can't  teach  it  all  in  3rd  or  5th  grade.  So  the  teachers  will  say  that 
the  tests  focus  on  Math  and  English,  and  that's  how  we  get  our  pay 
increases  because  if  our  students  do  better  on  ITBS  [Iowa  Test  of  Basic 
Skills],  we  get  merit  pay. 

The  teachers  don't  want  the  university  students  in  the  classroom  during 
test  time,  and  if  they  are  in  there,  they  want  them  to  help  them  prepare  for 
the  test.  Our  program  was  shut  down  six  weeks  before  the  Iowa  Test  of 
Basic  Skills. 

In  general,  science  is  low  on  the  totem  pole,  science  and  science  education. 
Especially  when  faced  [with]  pressure  for  literacy  and  math,  science  gets 
pushed  back.  ETS  [Educational  Testing  Service]  needs  to  start  adding 
science  to  tests  or  it  will  be  pushed  down. 

This  challenge  seemed  to  be  particularly  acute  for  outreach  programs  that 
partnered  with  urban  schools.  Moreover,  these  comments  reflect  how  the  focus 
on  improving  test  scores  and  the  incentive  of  merit-based  pay  can  undermine 
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efforts  to  improve  science  education,  particularly  since  science  is  often  not  a 
focus  of  many  state  and  district  testing  policies. 


Strong  District  Leadei^hip  Is  Needed  to  Support  Changes  in 
Science  Curriculum 

It  is  important  that  districts  be  aware  of  and  support  the  necessary  changes  in 
classrooms  that  occur  as  a  result  of  inquiry-based  practices.  Many  of  these 
inquiry-based  approaches  bring  a  different  method  of  teaching  into  the 
classroom,  a  teaching  style  that  encourages  students  to  explore  their  own 
questions,  and  require  a  certain  amount  of  freedom  in  the  classroom.  In  many 
urban  schools,  classroom  management  is  of  paramount  importance.  Principals 
that  observe  what  appears  to  be  mayhem  in  the  classroom  may  judge  a  teacher's 
performance  harshly.  One  teacher  commented: 

My  principal  is  a  stickler  for  discipline,  and  if  he  comes  to  my  room  and  I 
have  these  kids  in  small  groups  and  all  this  noise.  I'm  going  to  have 
problems  with  my  rating. 

Strong  district  support  is  also  needed  to  stand  up  to  parents  who  may  not 
understand  or  who  oppose  some  of  the  changes  created  by  reform.  One  program 
director  describes  the  impact  of  not  having  strong  district  support  for  the  use  of 
kits: 


Most  parents  have  been  taught  through  textbooks,  and  they  want  the 
children  taught  the  same  way.  And  the  previous  superintendent  was  very 
political.  He  pretty  much  told  us  that  the  kits  are  much  better  than  the 
textbooks,  but  the  parents  want  the  textbooks.  And  that  was  disappointing 
to  me  because  the  superintendent  should  be  leading  the  charge.  He  should 
be  telling  them  that  these  textbooks  are  not  the  way  to  be  going  for  the  new 
century.  And  if  he  catches  some  flack  for  it,  so  what.  But  he  was  going  to  be 
expedient.  So  if  the  parents  wanted  textbooks  and  yelled  loud  enough, 
whether  the  kids  learned  or  not  was  secondary. 


Concluding  Thoughts 

Outreach  programs  affected  K-12  schools  in  many  different  ways.  Comments 
from  teachers  and  program  directors  indicated  that  these  programs  had  the 
following  impacts: 

•  increased  the  science  content  knowledge  in  the  classrooms 

•  supported  changes  in  teacher  instructional  practices 

•  increased  collegiality  among  teachers 
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•  provided  needed  resources  and  materials  for  science  instruction 

•  motivated  many  K-12  students  to  take  an  interest  in  science. 

Science  graduate  and  undergraduate  students  played  a  key  role  in  these 
programs  by  providing  the  resources  and  support  necessary  to  promote  changes 
in  teacher's  instructional  practices  and  attitudes  toward  teaching  science. 
Although  many  of  the  reforms  in  science  education  provide  clear  goals  and 
objectives  for  what  science  ought  to  look  like,  they  provide  little  indication  of 
how  to  get  there  (Clune  et  ak,  1997).  Without  a  road  map  or  a  clear  indication  of 
the  path  to  implementation,  it  is  easy  for  many  teachers  to  falter,  devise  the 
curriculum  based  on  a  limited  understanding  of  science,  or  revert  to  more 
comfortable  and  familiar  ways  of  teaching  science.  Thus,  outreach  programs  that 
utilize  university  students  may  be  useful  in  bridging  the  gap  between  current 
practices  in  science  education  and  practices  that  are  aligned  with  the 
recommendations  of  the  science  standards. 

The  multidimensional  nature  of  the  support  the  university  students  provided 
was  a  key  ingredient  in  facilitating  some  of  the  impacts  that  were  identified.  The 
teachers  were  able  to  draw  on  the  science  students'  ability  to  provide  expertise  in 
science  content,  to  support  teachers'  learning  of  new  scientific  techniques,  and  to 
serve  as  role  models  and  motivators  for  the  K-12  students.  This  versatility  meant 
that  science  graduate  and  undergraduate  students  could  specifically  provide  the 
type  of  support  teachers  needed  to  implement  changes  in  classrooms.  And  even 
though  these  changes  might  have  occurred  anyway  over  the  long  run,  time  is  a 
precious  commodity  that  many  students  are  not  given  enough  of,  particularly 
students  in  urban  schools.  For  each  year  of  incremental  progress  toward 
changing  teacher  attitudes  and  gradually  changing  teacher  practices,  a 
generation  of  students  may  be  losing  opportunities  to  develop  the  solid 
foundation  in  math  and  science  necessary  to  contribute  to  a  society  that  has 
become  increasingly  scientifically  and  technologically  based. 

For  some  programs,  it  was  difficult  to  distinguish  the  impacts  due  to  the  science 
students  from  those  that  were  due  to  other  resources  provided  by  the  outreach 
program.  For  example,  it  may  be  that  simply  combining  increased  time  with 
specific  content  improves  student  learning.  Even  in  these  instances,  it  can  be 
argued  that  simply  facilitating  these  opportunities  to  learn  made  the  science 
students  a  meaningful  part  of  the  impact.  Clearly,  one  of  the  future  research 
issues  that  emerges  from  these  findings  is  the  need  to  determine  which  efforts 
truly  require  the  input  of  science  graduate  and  undergraduate  students.  Science 
graduate  students,  in  particular,  are  a  critical  part  of  the  research  university,  and 
it  is  important  for  programs  to  be  able  to  effectively  utilize  the  skills  and  talents 
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these  students  bring  to  K-12  schools.  Future  research  designed  to  look  at  this 
issue  might  compare  classrooms  having  teachers'  aides  with  classrooms  having 
science  students  as  one  way  to  gauge  the  impact  of  science  students  in  the 
classroom. 

Another  important  issue  for  fufure  research  is  how  fo  measure  fhe  impacfs  of 
fhese  programs.  The  findings  in  fhis  secfion  provide  an  imporfanf  sfarfing  poinf 
for  considering  and  developing  fhe  fypes  of  mefrics  fhaf  could  be  used  fo 
evaluafe  fhe  impacfs  of  fhese  programs.  The  informafion  presenfed  here 
highlighfs  the  variety  of  impacfs  fhese  programs  had  on  bofh  feachers  and 
sfudenfs  and  suggesfs  fhaf  mulfiple  mefrics  are  needed  fo  assess  fhe  impacfs  of 
fhe  programs  fully.  Moreover,  fhe  usual  mefrics  for  evaluation,  such  as  an 
increase  in  mafh  or  science  fesf  scores,  may  nof  be  fhe  mosf  significanf  or  fhe 
mosf  appropriafe  oufcomes  fo  expecf  from  fhese  programs.  Inferviewee 
commenfs  suggesf  fhat  some  of  fhe  greafesf  impacfs  were  fhe  affifudinal  changes 
fhe  programs  fosfered  toward  science.  One  may  well  argue  fhaf  fhese  sorfs  of 
changes  are  needed  before  meaningful  changes  in  feaching  pracfice  can  fake 
place.  Assessmenfs  geared  toward  defecting  or  measuring  fhe  changes  in 
affifudes  toward  science  on  fhe  parf  of  feachers  and  sfudenfs  may  be  one  way  fo 
evaluafe  fhe  impacfs  of  such  programs  (see,  for  example,  NSF,  1998).  Ofher 
assessmenfs  could  focus  on  skills  fhaf  combine  scienfific  process  knowledge  wifh 
scientific  confenf  knowledge.  For  example,  feachers  were  eager  fo  share  sfories 
abouf  sfudenfs'  abilify  fo  refain  defailed  informafion  abouf  different  science 
activities  and  their  increased  curiosity  and  interest  in  science  topics.  Exploration, 
explanation,  description  and  observation  are  all  critical  components  of  inquiry- 
based  approaches  fo  science.^  Thus,  fesfs  could  be  developed  fhaf  evaluafe  fhe 
scienfific  sophisficafion  of  sfudenfs'  questions  or  fhe  level  of  defail  used  fo 
describe  differenf  phenomena. 

The  commenfs  in  fhis  secfion  also  suggesf  fhat  examining  the  impacts  on  teachers 
is  equally  important  for  full  program  assessmenf.  Since  much  of  fhe  focus  is  on 
changing  feacher  pracfices  and  teacher  affitudes,  an  imporfanf  mefric  mighf  be  fo 
examine  or  look  for  increased  confidence  and  competency  in  teaching  science. 
School-level  changes  might  be  another  metric  for  evaluafion.  For  example,  is 
fhere  increased  collaborafion  and  discussion  among  feachers  as  a  resulf  of  fhe 
programs?  Are  feachers  confinuing  fo  spend  more  fime  on  science  insfrucfion, 
and  are  fhey  learning  how  fo  failor  science  insfrucfion  fo  fhe  needs  of  fheir 
sfudenfs? 


^See  Kahle  (1998)  for  a  discussion  of  different  sorts  of  indicators  that  can  be  used  to  assess  the 
quality  of  different  science  and  math  reforms. 
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It  is  a  long  path  from  implementing  reform-based  pracfices  in  fhe  classroom  fo 
demonsfrafing  improved  sfudenf  learning.  Along  fhe  way,  if  is  imporfanf  fo  have 
resources  fhaf  help  feachers  and  sfudenfs  remain  on  fhe  pafh.  The  oufreach 
programs  and  fhe  science  sfudenfs  fhaf  parficipafe  in  fhem  may  be  invaluable 
resources  for  fhis  process.  Moreover,  fhese  programs  mighf  serve  as  cafalysfs  fo 
facilifafe  fhe  alignmenf  of  cerfain  pieces  of  fhe  reform  fo  allow  more-focused 
measures  foward  improved  sfudenf  leaning  in  science  fo  be  successful. 
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4.  Outreach  Programs:  The  Perspective  from 
Institutions  of  Higher  Education 


This  section  tackles  the  question  of  higher-education  impacts  by  examining  the 
perspectives  of  the  science  graduate  and  undergraduate  students,  program 
directors,  coordinators  and  managers  that  participated  in  these  eight  outreach 
programs.  As  Section  3  showed,  outreach  programs  that  link  universities  and 
schools  offer  numerous  benefifs  fo  K-12  classrooms  in  the  form  of  classroom 
supporf  from  graduafe  and  undergraduafe  sfudenfs,  insfrucfional  resources,  and 
curriculum  assisfance.  This  section  examines  the  other  side  of  fhe  parfnership 
and  asks  whaf  impacfs  fhese  programs  have  on  insfifufions  of  higher  educafion, 
and  more  specifically  whaf  do  universities,  and  science  departments  in 
particular,  gain  through  partnerships  with  K-12  classrooms.  Do  these  outreach 
programs  provide  more  than  a  warm,  fuzzy  feeling?  The  answers  fo  fhese 
questions  are  critical  because,  although  most  outreach  programs  are  designed  to 
be  partnerships,  few  acfually  attain  this  goal.  Often,  outreach  programs  that  link 
universities  and  K-12  schools  are  implemented  with  the  assumption  that  the 
primary  benefits  are  unidirectional,  flowing  from  uni  versifies  to  K-12 
classrooms.  However,  a  broader  question  is  how  much  of  fhis  unidirecfionalify  is 
embedded  in  the  structure  of  oufreach  programs.  Cerfainly,  fhe  primary  purpose 
of  mosf  oufreach  programs  is  fo  supporf  fhe  improvemenf  of  K-12  educafion,  buf 
few  programs  evolve  fo  fhe  level  of  equal  knowledge-sharing  among  fhe 
parficipanfs.  Moreover,  analysis  of  the  impacts  on  institutions  of  higher 
educafion  is  often  neglecfed;  as  a  resulf,  few  programs  are  designed  in  ways  fhat 
can  maximize  fhe  positive  affribufes  of  fhe  programs  for  both  institutions  of 
higher  educafion  and  K-12  schools. 

This  section  follows  a  sfructure  similar  fo  fhaf  of  Section  3.  If  begins  wifh  a 
description  of  fhe  universifies  and  how  fhe  oufreach  programs  are  sfrucfured 
wifhin  them.  The  following  subsecfion  (and  here  we  deparf  from  fhe  paftern  of 
fhe  previous  secfion)  discusses  fhe  mofives  for  parficipafion  among  graduafe  and 
undergraduafe  sfudenfs,  program  direcfors,  coordinators,  and  managers.  We  felf 
fhis  discussion  was  imporfanf  fo  include  for  a  number  of  reasons.  Parficipafion  in 
oufreach  programs  is  volunfary  for  many  of  fhe  higher-education  parficipanfs, 
and  idenfifying  fhe  motives  for  parficipafion  may  reveal  imporfanf  clues  about 
the  success  and  effectiveness  of  programs.  Also,  the  reasons  for  parficipafion  for 
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many  program  directors  and  managers  were  linked  to  the  impacts  they  wanted 
the  programs  to  have,  so  we  thought  it  was  useful  to  identify  fhem. 

Following  fhe  maferial  on  mofives,  we  discuss  fhe  program  imparts.  Many  of  fhe 
universify  sfudenfs  we  spoke  wifh  were  eifher  currenfly  participating  in  one  of 
fhese  programs  or  had  jusf  complefed  work  wifh  one,  and  fheir  commenfs  reflecf 
immediafe,  shorf-ferm  impacfs.  Inferviews  wifh  program  direcfors  and  managers 
whose  parficipafion  in  fhese  programs  spanned  a  number  of  years  provided 
insighfs  info  some  of  fhe  broader,  long-ferm  impacfs  of  fhese  programs.  The 
commenfs  from  fhe  program  direcfors  and  managers  are  imporfanf  here  because 
fhey  link  fhe  impacfs  in  fhis  secfion  fo  sfrafegies  for  long-term  program 
outcomes.  We  conclude  by  discussing  whether  the  impacts  identified  can  be 
formalized  as  program  goals  for  parficipanfs  from  fhe  higher-educafion  culfure. 
Do  these  programs  offer  significanf  benefifs  fhaf  can  be  expanded  on?  Or  do 
fhese  programs  pose  ofher  problems — such  as  increasing  fime-fo-degree  for 
graduafe  sfudenfs  or  recruifmenf  and  refenfion  problems  fhaf  might  undermine 
the  success  of  fhese  programs?  As  we  will  discuss  furfher  in  Secfion  5,  fhe 
answers  fo  fhese  quesfions  are  a  crifical  link  fo  program  susfainabilify. 


Sponsoring  Universities  and  Outreach  Program  Structure 

All  of  fhe  graduafe  and  undergraduafe  sfudenfs  we  inferviewed  atfended 
Research  1  universifies.  According  fo  fhe  Carnegie  Classification  of  Insfifufions 
of  Higher  Education,  insfifufions  of  fhis  fype  offer  a  full  range  of  baccalaureafe 
programs,  are  commiffed  fo  graduafe  education  fhrough  fhe  docforafe,  and  give 
high  priorify  fo  research.  They  award  50  or  more  docforal  degrees  each  year.  In 
addifion,  fhey  receive  $40  million  or  more  in  federal  supporf  annually.  Graduafe 
sfudenfs  play  an  imporfanf  role  in  Research  1  universifies  and  represenf  a 
valuable  workforce  for  fhe  universify.  The  emphasis  on  research  in  fhese 
universifies  offen  means  fhaf  faculfy  members  in  fhe  sciences  spend  a  majorify  of 
fheir  fime  engaged  in  research,  while  graduafe  sfudenfs  confribufe  greafly  fo  fhe 
feaching  of  fhe  undergraduafe  sfudenfs.  This  is  particularly  frue  for  many  of  fhe 
science  courses,  where  mosf  graduafe  sfudenfs  usually  supporf  fhemselves  for 
parf  of  fheir  fenure  on  sfipends  received  as  feaching  assisfanfs. 

For  mosf  of  fhe  programs  we  examined,  granfs  for  fhe  ouf reach  program  were 
awarded  fo  fhe  universify,  and  fhe  principal  investigator  of  fhe  granf  was  usually 
a  full-time  professor  wifhin  fhe  science  deparfmenf.  Because  of  fhe  educational 
nature  of  fhese  awards,  collaborafions  befween  science  deparfment  and  school  of 
educafion  faculfy  were  frequenf.  For  example,  in  one  program,  fhe  educational 
oufreach  componenf  was  a  small  piece  of  a  much  larger  granf  fo  the  science 
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department.  As  such,  primary  responsibility  for  the  educational  component  was 
handed  over  to  faculty  within  the  school  of  educafion.  The  responsibilifies 
included  setting  up  and  sfrucfuring  fhe  program  and  recruiting  science  sfudenfs. 
Alfhough  science  faculfy  members  were  aware  of  fhe  educational  componenf  of 
fhe  granf,  fheir  responsibilify  for  ensuring  ifs  success  was  minimal.  Ofher  models 
of  collaborafions  usually  involved  a  senior  faculfy  member  in  fhe  science 
deparfmenf  working  wifh  school  of  educafion  personnel.  In  fhese  instances, 
recruitment  of  graduafe  and  undergraduafe  sfudenfs  often  fell  fo  a  single 
member  of  fhe  science  faculfy,  and  ofher  parfs  of  fhe  program,  such  as 
pedagogical  fraining,  were  fhe  responsibilify  of  school  of  educafion  sfaff. 


Motivation  for  Participation  in  Outreach  Programs: 
Graduate  and  Undergraduate  Students 

Wifh  fhe  exception  of  fhe  sfudenfs  in  fhe  feacher-preparafion  program,  all  of  fhe 
graduafe  sfudenfs  we  inferviewed  infended  fo  pursue  research  careers,  eifher  in 
academia  or  indusfry.  Similarly,  fhe  undergraduafes  were  also  on  a  professional 
frack,  wifh  plans  fo  affend  medical  school  or  graduafe  school  in  a  scientific 
discipline.  So,  in  fhe  absence  of  a  practical  consideration,  such  as  preparation  for 
feaching  careers,  why  did  fhe  opporfunify  fo  go  info  K-12  classrooms  or  work 
wifh  K-12  feachers  appeal  fo  many  of  fhem?  Inferviews  wifh  undergraduafe  and 
graduafe  sfudenfs  indicafed  one  or  more  of  fhe  following  four  mofivafions: 

•  fhe  opporfunify  fo  use  fheir  science  knowledge  in  a  broader  confexf 

•  fhe  experience  and  challenge  of  inferacfing  wifh  a  difterenf  populafion 

•  improvemenf  in  communication  skills 

•  fhe  sizable  compensations  fhaf  some  programs  offered. 

The  opporfunify  fo  use  science  knowledge  fo  make  a  difference  in  fhe  schools 
and  fhe  surrounding  communifies  was  one  of  fhe  mosf  frequenfly  cifed  motives. 
Working  beyond  fhe  laboratory  and  having  real-world  impacfs  was  an  imporfanf 
componenf  of  oufreach  programs: 

I  was  working  in  a  lab.  I  didn't  like  it;  it  didn't  connect  me  to  the  outside 
world,  and  I  was  looking  for  other  options  to  interact  science  with  the  real 
world,  and  I  really  liked  it. 

I  could  go  to  school  and  come  to  classes,  and  that's  just  for  my  benefit,  but 
the  benefit  for  me  is  helping  other  people  out.  It's  a  worthwhile  cause.  I 
have  a  general  interest  in  science;  it's  helping  children,  and  I  think  that's 
important. 
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Graduate  students,  who  usually  worked  as  teaching  assistants  for  undergraduate 
courses,  found  fhe  experience  and  challenge  of  inferacfing  wifh  anofher 
populafion  fo  be  parficularly  affracfive: 

I  was  told  about  the  program  by  the  vice  chairman.  In  the  graduate 
chemistry  department  we  have  to  cover  our  stipend  some  way,  so  this 
fulfilled  that  requirement  and  provided  me  an  option  to  help  within  the 
commimity,  which  is  something  I  wanted  to  do. 

I  wasn't  too  thrilled  about  interacting  with  another  group  of 
undergraduates,  and  the  thought  of  having  a  different  student  population 
as  a  teaching  requirement  was  something  that  appealed  to  me. 

Some  science  faculty  were  surprised  at  the  value  their  students  placed  on 
outreach,  expecting  students  on  professional  career  fracks  fo  be  more  inferesfed 
in  programs  more  aligned  with  their  career  goals: 

I  was  not  sensitive  to  how  interested  undergraduates  are  in  doing  this!  For 
example,  I  was  amazed  at  these  two  students,  both  premed  students  that 
have  no  long-term  interest  in  education,  but  they  had  enough  interest  to 
work  with  me  a  whole  semester  without  any  obvious  payoff  in  terms  of 
their  career. 

On  the  more  pragmatic  side,  many  students  believed  that  participation  in  these 
outreach  programs  would  help  them  improve  their  communication  skills. 
Moreover,  communicating  effectively  with  a  broader  audience  was  thought  to  be 
an  important  skill  for  scienfisfs: 

For  me  it  was  sort  of  a  selfish  sort  of  thing,  to  get  better  at  commimicating 
science  because  I  realized  I  wasn't  particularly  good  at  communicating 
with  nonscientists,  and  I  wanted  to  get  the  experience  of  being  able  to  do 
that. 

I  think  scientists  have  an  obligation  to  explain  science  to  the  general  public 
because  the  people  who  you  are  educating  will  be  making  decisions  about 
funding  science  and  will  be  doing  things  like  sitting  on  juries,  evaluating 
scientific  information.  So,  I  think  informing  the  citizenry  about  science  and 
making  it  less  scary  is  an  important  role  for  scientists  to  fulfill. 

Some  of  fhe  programs  offered  sizable  compensatory  packages;  however,  none  of 
fhe  graduafe  sfudenfs  cited  fhese  as  incenfives  or  reasons  for  parficipafion. 
Alfhough  if  is  difficult  to  assess  the  degree  to  which  the  compensation  attracted 
students  to  participate  in  outreach  programs,  it  seems  fair  fo  conclude  fhaf  none 
of  fhe  graduafe  sfudenfs  we  interviewed  were  doing  if  solely  for  fhe  money. 

On  fhe  ofher  hand,  for  programs  fhaf  ufilized  undergraduate  sfudenfs, 
compensafion  played  an  imporfanf  role.  It  ensured  their  continued  participation 
in  the  program  and  guaranteed  some  level  of  consisfenf,  responsible  behavior  on 
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the  part  of  the  students.  One  program  coordinator  noted  the  importance  of 
providing  stipends  for  undergraduafe  sfudenfs: 

The  other  piece  that  has  to  be  considered  is  that  this  program  pays  the 
students,  so  there  is  a  greater  incentive  for  them  to  be  present.  So  they  are 
responsible  in  a  different  way  than  volunteers.  We  found  that,  with  the 
undergraduates  they  are  very  apt  not  to  show  up.  Even  if  they  are 
enthusiastic  and  want  to  do,  there  is  something  missing  in  the  follow-up. 

Undergraduafe  sfudenfs  in  fhe  feacher-preparafion  program  also  cifed  sfipends 
as  one  major  reason  fhey  were  affracfed  fo  fhe  teacher-preparation  program. 
Some  undergraduate  mathematics  majors  explained  to  us  that  the  amount  of  fhe 
sfipend  was  a  key  reason  for  inferesf  in  feacher-preparafion  programs: 

I  thought  what  was  great  about  coming  here  was  knowing  that  I  can  get 
paid,  get  a  stipend  for  just  observing  teachers  and  stuff.  ^  I  put  in  four  hours 
a  week  for  a  year,  that's  not  bad  for  a  thousand-dollar  stipend  a  quarter. 

I  knew  there  was  money,  a  stipend;  that  interested  me  of  course.  Also,  I 
think  the  reason  why — if  I  was  going  to  go  into  education,  I  was  aware  of 
the  other  programs  that  make  you  pay — I  mean  they  make  you  do  a  whole 
year  of  student  teaching.  In  this  program,  I  get  my  master's  degree  and  I 
get  paid  for  doing  this  my  junior  and  senior  year. 


Motivation  for  Participation  in  Outreach  Programs: 
Program  Directors,  Coordinators,  and  Managers 

Program  directors,  coordinators,  and  managers  with  scientific  backgrounds  also 
wanfed  fo  share  science  knowledge  wifh  schools  and  communifies  and  valued 
making  "real-world"  impacf  on  educational  issues.  Many  of  fhe  program 
direcfors,  coordinafors,  and  managers  we  spoke  wifh  described  a  single  incidenf, 
a  poinf  of  awareness  abouf  fhe  sfafe  of  science  educafion  fhaf  mobilized  fhem  fo 
eifher  inifiafe  a  program  or  fo  parficipafe  in  an  exisfing  one: 

My  initial  involvement  started  with  a  student  that  worked  in  my  lab  for 
two  years.  He  got  very  excited  about  working  in  the  school  system,  and  the 
reason  I'm  involved  is  that  he  brought  local  high  school  students  to  look  at 
the  greenhouse.  I  gave  them  a  tour  of  the  greenhouse.  I  was  so  amazed  at 
how  little  they  knew — that  was  the  stimulus!  These  kids  knew  zero,  and 
these  kids  were  taking  high  school  biology! 

I  noticed  my  grandson  getting  bored  with  science,  and  I  went  to  see  the 
principal.  I  told  her  what  I  was  thinking  and  asked  if  I  could  speak  to  the 


^The  emphasis  of  the  quote  is  on  the  importance  of  stipends  to  undergraduates.  As  noted,  this 
student  participated  in  a  teacher-preparation  program  that  required  one  year  of  teacher  observation 
as  part  of  training.  We  do  not  want  this  student's  comments  to  leave  the  mistaken  impression  that 
university  science  students  typically  observed  teachers  rather  than  supported  them  in  the  classrooms. 
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faculty  with  the  idea  that  I  would  offer  them  this  program  and  see  if  it 
would  grow  and  do  it  as  a  pilot  project  purely  on  a  volimtary  basis. 

These  comments  suggest  that  an  awareness  of  the  issues  in  K-12  schools  can 
mobilize  scientists  to  become  involved  in  outreach  activities. 

We  also  noted  a  predominance  of  women  who  had  complefed  science  doctoral 
degrees  (in  some  cases  posfdocforal  research)  parficipating  in  fhese  programs. 
Their  commenfs  suggested  fhaf  fhey  found  a  high  degree  of  fulfillmenf  in 
working  af  a  programmatic  level  in  oufreach  programs.^ 

Ofher  program  direcfors,  managers,  and  coordinators  cifed  social  concerns  as  a 
primary  motivafing  force  for  fheir  involvemenf.  Gender  and  equify  concerns 
about  the  composition  of  fhe  fufure  workforce  were  two  of  fhe  issues  program 
direcfors  viewed  as  crifical  areas  thaf  could  be  addressed  through  these 
programs.  For  example,  one  respondent  remarked  on  the  need  to  create  a  larger 
pool  of  minorify  physicians  and  saw  achievement  in  math  and  science  as  one 
way  to  get  there: 

The  research  is  very  clear.  Students  coming  out  of  imderserved 
populations  are  more  likely  to  go  back  to  serve,  and  there  is  evidence  that 
minority  physicians  are  apt  to  serve  those  populations.  So  I  have  a  vested 
interest  to  see  that  those  young  students  with  talent,  that  we  tap  those 
students  with  potential  and  get  them  motivated  so  that  they  will  not  only 
be  more  excited  about  science,  but  they  will  also  pursue  health  careers, 
careers  in  biomedical  science,  physicians,  engineers  in  all  the  areas  that  we 
are  underrepresented. 

For  other  programs,  social  justice  was  a  major  theme  and  strong  educational 
preparation  in  math  and  science  was  seen  as  a  direct  path  to  achieving  this: 

It  is  not  just  good  enough  to  be  a  good  science  teacher.  We  are  looking  for 
good  science  teachers  that  are  committed  to  all  kids.  Most  of  the  teachers 
[in  our  teacher-preparation  program]  did  not  come  from  low-income  areas. 

So,  these  aren't  their  communities.  And  so,  we  are  trying  to  figure  out  how 
do  you  get  people,  students  of  color,  committed  to  these  educational  arenas 
to  want  to  teach  and  go  back  to  their  communities? 

Others  felt  that  the  needs  of  fhe  surrounding  communify  had  largely  been 
neglecfed  and  fhaf  fhe  mofivafion  for  fhe  program  was  to  match  the  mission 
statement  of  the  university: 

The  president  [of  the  university]  said  that  this  university  would  no  longer 
be  considered  an  ivory  tower,  an  enclave  surrounded  by  this  urban 


^There  seems  to  be  an  untold  story  about  the  contributions  of  women  scientists  to  education 
outreach  programs.  Although  this  is  not  directly  related  to  the  present  work,  further  research  may  be 
useful  in  uncovering  ways  fo  tap  into  this  resource. 
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community.  It  was  critical  that  the  imiversity  focus  on  the  needs  of  the 
commimity  and  have  community  programs  that  matched  the  mission  of 
the  university. 

Motives  for  participation  played  a  critical  role  in  the  success  of  these  programs. 
As  discussed  in  Section  5,  a  common  characteristic  of  many  of  the  outreach 
programs  we  examined  was  a  shared  vision  among  programmatic  staff  that 
viewed  the  goals  of  outreach  more  broadly  than  simply  improving  science 
learning. 


Impact  on  Graduate  and  Undergraduate  Students 

Despite  the  differences  in  the  students  we  interviewed  and  the  types  of  programs 
they  participated  in,  two  impacts  from  participating  in  outreach  programs  were 
often  mentioned.  The  first  had  to  do  with  the  growth  and  knowledge  of  science 
and  learning  science,  such  as  improved  communication  skills,  reassessment  of 
their  own  learning,  and  understanding  of  scientific  concepts.  The  second  had  to 
do  with  the  perspective  students  gained  from  participating  in  these  programs. 
Many  students  commented  on  awareness  of  different  learning  styles  and  a 
greater  appreciation  of  the  skills  necessary  to  be  a  teacher.  In  this  subsection,  we 
discuss  each  of  these  impacts  and  their  significance  in  leading  to  outcomes  for 
reshaping  the  graduate  student  experience.  We  also  ask  what  it  would  take  to 
make  these  impacts  more  substantial  or  more  far  reaching.  Can  a  year  of 
outreach  be  expected  to  make  an  impact  on  the  experience  of  university  science 
students,  or  is  the  experience  of  graduate  and  undergraduate  education 
enhanced  because  of  programs  like  this? 


Interacting  with  K-12  Teachers  and  Students  Causes  Students  to 
Reassess  Their  Own  Learning  and  Understanding 

Improved  communication  skills  were  one  of  the  main  impacts  that  graduate 
students  reported.  Most  of  them  were  attracted  to  these  programs  for  the 
opportunity  to  communicate  science  to  a  broader  audience.  Perhaps  what  was 
more  surprising  for  the  graduate  students  was  the  extent  to  which  they  had  to 
reevaluate  how  much  they  understood  about  the  science  they  thought  they 
knew.  For  many,  the  improved  communications  skills  came  as  a  result  of  having 
to  reassess  their  own  understanding  of  many  scientific  concepts  that  they  had 
taken  for  granted.  Many  graduate  students  remarked  on  the  amount  of  learning 
that  takes  place  when  one  has  to  explain  concepts  to  others  who  may  not  be  as 
familiar  with  the  scientific  jargon: 
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It's  given  me  a  great  opportunity  to  teach  some  research.  Actually,  a  lot  of 
things  I  do,  I  do  by  rote.  I  know  how  to  do  them,  explaining  it  makes  me 
try  to  think  about  why  I  am  doing  it  and  what  purpose  it  has. 

I  feel  that  I  benefit  because  I  go  back  to  remember  things.  It  clarifies  things 
for  me,  I  realize  the  misconceptions  I  had. 

Different  classrooms  have  different  science  kits.  I  know  I  don't  remember  a 
lot  about  different  topics  from  my  school  days,  so  it  helps  me  to  review  and 
present  that  to  the  class. 

Many  of  the  graduate  students  spent  time  as  teaching  assistants  for  science 
courses  within  their  disciplines,  but  serving  as  a  teaching  assistant  was,  by  some 
accounts,  a  very  formulaic  experience.  However,  in  teaching  to  a  broader 
audience,  the  graduate  students  were  forced  to  think  more  deeply  about  things. 
Explaining  a  concept  like  electricity  to  a  sixth  grader,  without  it  degenerating 
into  equations,  was  a  challenge  for  most  graduate  students.  As  a  result,  they 
were  able  to  reassess  their  own  learning,  something  being  a  teaching  assistant 
did  not  inspire.  Comments  from  interviewees  suggested  that  this  reassessment  of 
learning  is  uniquely  a  function  of  teaching  to  and  interacting  with  persons 
outside  of  the  scientific  community.  For  example,  in  the  teacher-researcher 
programs,  graduate  students  said  that  working  with  teachers  forced  them  to 
think  more  about  the  core  issues  of  the  research  projects  they  were  working  on. 
Teachers  cared  much  more  about  the  goals  and  purpose  of  the  research  rather 
than  some  of  the  methodological  details.  Teacher-researcher  programs  also 
provided  the  added  benefit  of  helping  the  graduate  students  learn  to  manage  and 
supervise  research  activities,  which  some  graduate  students  viewed  as  an 
important  experience: 

I  am  kind  of  thinking  about  going  into  academia  at  the  end  of  this,  and 
while  TAing^  is  going  to  give  me  a  lot  of  classroom  experience,  it's  not 
going  to  give  me  a  lot  of  experience  directing  other  people's  research. 

Moreover,  many  graduate  students  themselves  felt  that  they  had  more  of  an 
impact  in  working  in  K-12  classrooms  than  in  serving  as  TAs  in  undergraduate 
science  courses  where  the  majority  of  their  time  would  be  spent  "haggling  over 
[a]  1-point  grade  difference  with  a  premed  major." 


3. 


TAing"  refers  to  the  activity  of  working  as  a  teaching  assistant. 


48 


Partnerships  with  Urban  Schools  Provide  Students  with  a  Broader 
Context  and  Understanding  of  Education 

Graduate  and  undergraduate  students  who  supported  K-12  teachers  in 
underserved  communities  found  that  working  in  urban  schools  provided  them 
an  opportunity  to  see  and  understand  the  ways  in  which  environment  and 
resources  can  affect  learning.  When  asked  about  their  experiences  in  the 
classrooms,  many  students  mentioned  motivation  to  learn  as  one  of  fhe  unique 
challenges  fhey  faced  in  supporfing  K-12  feachers  in  inner-cify  schools: 

If  you  have  an  undergrad  at  the  university,  the  kids  are  looking  to  get  the 
education.  It's  almost  like  force-feeding  for  some  of  the  kids  in  the  high 
school.  They  don't  see  anything  beyond  their  life.  The  come  from  radically 
different  backgrounds  compared  to  students  at  the  university.  They  don't 
see  the  point.  The  challenge  is  to  actually  bring  them  into  class  and  make 
them  pay  attention,  and  show  them  that  yes  you  can  do  science,  and  it  isn't 
just  for  somebody  else. 

Despife  the  challenges,  many  students  felt  that  their  work  in  K-12  schools  was 
more  valuable  than  their  work  as  teaching  assistants  in  the  university. 


Impacts  on  Institutions  of  Higher  Education 

We  were  also  interested  in  whether  these  programs  had  impacts  beyond  the 
graduate  and  undergraduate  students.  For  example,  by  participating  in  outreach 
programs,  did  program  participants  feel  fhaf  insfifufions  gain  more  credibilify  in 
fhe  communify?  Did  fhe  participation  in  outreach  increase  the  number  of 
undergraduafes  faking  cerfain  courses,  or  increase  fhe  number  of  majors,  or 
diversify  of  sfudenfs  wifhin  cerfain  deparfmenfs?  The  answers  fo  fhis  quesfion 
varied  wifh  fhe  scope  of  fhe  oufreach  program.  However,  mosf  program 
direcfors  felf  fhaf  parficipafion  in  oufreach  program  enhanced  fhe  image  of  fhe 
insfifufion  in  fhe  eyes  of  fhe  communify.  This  was  particularly  frue  for 
insfifufions  fhaf  had  sfrained  relations  wifh  fhe  communify  or  were  perceived  fo 
be  ivory  fower  enclaves,  removed  from  fhe  neighborhoods  around  fhem: 

The  university  had  an  isolationist  approach  to  the  community,  and  the 
only  way  they  interacted  with  the  community  is  when  they  wanted  data 
from  them.  The  schools  have  had  a  whole  series  of  these  attempts  that 
petered  out,  so  there  is  a  lack  of  tmst.  Having  had  these  experiences,  the 
schools  have  learned  not  to  depend  [on  the  university]  very  much. 

However,  enough  good  stuff  has  happened  with  the  university  in  the  last  5 
years  that  they  at  least  come  to  the  table. 


49 


Moreover,  many  program  directors  reported  that  K-12  teachers  took  pride  in 
their  affiliation  and  connection  with  the  institution  and  that  this  went  a  long  way 
toward  community  building. 

In  addition  to  improved  community  relations,  a  few  programs  focused  on 
reshaping  fhe  qualify  of  undergraduafe  and  graduafe  educafion  in  science  and 
fhe  role  of  oufreach  programs  toward  fhaf  goal: 

This  program  is  changing  the  nature  of  outreach  and  adding  a  new 
dimension.  It  is  about  improving  undergraduate  and  graduate  education. 

It  is  not  just  another  thing  for  the  students  to  do.  Students  are  affiliated  and 
engaged  in  a  department,  designing  outreach  units.  We  are  changing  and 
improving  undergraduate  education,  science  research,  and  science 
education. 

As  explained  by  one  program  manager,  engaging  science  undergraduate  majors 
in  outreach  programs  is  good  for  fhe  universify.  Undergraduafe  science  core 
requiremenfs  fypically  have  low  approval  rafe  among  fhe  sfudenfs.  Linking 
science  courses  fo  oufreach  programs,  a  feafure  fhaf  mosf  sfudenfs  give  high 
ratings  af  fhe  universify,  may  be  one  way  fo  engage  sfudenfs  and  also  fo  solve 
sfrafegic  communify  problems. 

To  many  fhaf  we  interviewed,  fhese  oufreach  programs  clearly  fhaf  offered 
graduafe  sfudenfs  a  unique  fype  of  teaching  and  learning  experience.  Many 
program  directors  fell  fhaf  fhese  programs  provided  a  level  of  in-depfh  learning 
fhaf  was  importanf  in  reshaping  and  improving  graduafe  educafion: 

If  you  give  these  grad  students  a  hard  problem  from  a  textbook,  they  can 
do  it,  but  they  can't  quite  explain  what  that  has  to  do  with  the  world. 

Here's  an  opportunity  for  an  improvement  of  graduate  school  education, 
and  the  students  see  the  value  in  it.  It's  more  than  a  warm  fuzzy  feeling. 

We  are  providing  applied  learning  that  they  can  tolerate. 

Furthermore,  some  program  directors  believed  that  the  experience  of 
parficipafing  in  oufreach  could  benefif  graduafe  sfudenfs  by  helping  fhem  wifh 
fheir  feaching  skills.  Improving  fhe  teaching  skills  of  graduafe  sfudenfs  was  also 
viewed  as  a  benefif  fo  fhe  universify,  parficularly  when  many  graduafe  sfudenfs 
serve  as  feaching  assisfanfs  for  undergraduafe  science  courses.  As  one  program 
coordinafor  summarized. 

This  is  a  great  opportimity  for  graduate  students,  providing  ways  that  this 
is  clearly  a  benefit  to  their  teaching.  Most  programs  like  this  [direct 
classroom  support]  are  in  the  humanities  and  social  sciences,  but  it  is  really 
important  to  explore  this  in  the  physical  sciences. 
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Challenges  Within  the  Universities 

An  important  goal  for  most  of  fhe  oufreach  programs  was  susfainabilify. 
Program  direcfors  expressed  fhe  desire  fo  have  their  programs  exist  as  an 
integral  part  of  fhe  universify.  Thus,  in  answering  our  quesfions  abouf  fhe 
challenges,  respondenfs  offen  referred  fo  fhe  challenges  and  obsfacles  linked  fo 
creafing  susfainable  programs.  Many  of  fhese  challenges  were  based  on  fhe 
culfure  of  universifies,  particularly  of  Research  1  universifies,  and  fheir  focus  on 
research  and  research  producfs  as  one  of  fhe  mosf  valued  oufcomes  of  fhe 
universify  sysfem.  This  perspecfive  creafed  whaf  many  felf  was  an  exfremely 
narrow  focus  for  graduafe  educafion,  one  fhaf  devalued  feaching  and 
discouraged  any  acfivifies  fhaf  would  disfracf  graduafe  sfudenfs  from  fheir 
research  and  pofenfially  increase  fhe  fime-fo-degree  for  graduafe  sfudenfs.  We 
nexf  discuss  some  of  fhe  challenges  oufreach  programs  faced  from  universifies, 
challenges  fhaf  in  fhe  long  run  may  impacf  fheir  susfainabilify. 


Lack  of  Support  for  Outreach  Programs  Among  Science  Faculty 

Alfhough  many  science  faculfy  were  nof  direcfly  involved  in  fhese  programs, 
fheir  supporf  was  imporfanf.  Graduafe  and  undergraduafe  sfudenfs  offen  heard 
abouf  fhese  programs  from  deparfmenfal  faculfy,  and  so  fhe  endorsement  of 
science  faculfy  was  imporfanf  in  fhe  recruifmenf  and  susfained  parti cipafion  of 
graduafes  and  undergraduafes  in  fhese  programs.  Because  many  of  fhe  program 
direcfors,  coordinators,  and  mangers  we  interviewed  were  also  faculty  within  the 
science  departments,  they  were  able  to  offer  insighfful  commenfs  as  fo  why  many 
of  fheir  colleagues  were  nof  supportive  of  oufreach  programs.  The  reasons 
ranged  from  benign  disinferesf  fo  acfive  opposifion  fo  fhe  fundamental  concept 
of  fhe  oufreach  program  ifself.  For  example,  one  inferviewee  sfafed  "mosf  faculfy 
don'f  wanf  fo  be  bofhered  wifh  educational  oufreach  because  if  hinders  research 
producfivify."  Still  ofher  faculfy  were  skepfical  of  educafion  oufreach  programs 
and  view  fhem  as  having  very  little  impacf  on  achieving  fhe  sfafed  goals.  One  of 
fhe  program  direcfors  described  one  of  fhe  more  difficulf  aspecfs  of  setting  up 
fhe  program,  fhaf  of 

persuading  the  scientists  that  this  was  worthwhile.  Although  NSF 
mandated  that  there  be  some  educational  component  linked  to  this 
program,  it  was  met  with  cynicism  on  the  part  of  the  faculty.  Was  this 
anymore  than  political  correctness?  Would  there  be  any  real  impact  on  the 
people  that  this  program  is  designed  to  help?  So,  there  was  a  subgroup  of 
faculty  that  questioned  whether  this  was  a  worthwhile  activity. 
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Other  faculty  viewed  the  goals  of  oufreach  as  being  counfer  fo  fhe  goals  of  fhe 
graduafe  program  and  acfively  opposed  fhe  parficipafion  of  graduafe  sfudenfs  in 
fhe  oufreach  programs: 

[Participation  in  outreach]  would  be  discouraged  by  the  department.  It 
would  be  seen  as  a  diversion.  Graduate  students  are  so  focused  on  getting 
a  Ph.D.,  this  is  not  a  popular  alternative.  We  would  much  rather  have  them 
teach  university  courses,  which  looks  good  in  terms  of  job  himting. 

This  senfimenf  was  common  among  inferviewees  involved  in  direcf  classroom 
enhancemenf  programs  fhaf  placed  graduafe  sfudenfs  in  fhe  classrooms  wifh 
feachers.  In  facf,  a  combinafion  of  skepficism  abouf  fhe  impacf  of  oufreach 
programs  and  a  conviction  fhaf  oufreach  programs  using  graduafe  sfudenfs  in 
K-12  classrooms  had  little  long-ferm  payoff  led  to  the  development  of  fhe  one 
feacher-preparafion  program  we  sfudied.  In  fhe  commenf  below,  fhe  program 
director  describes  fhe  rationale  fhaf  led  fo  fhe  creafion  of  fhe  program: 

I  became  disillusioned  with  the  use  of  the  money.  It  was  difficult  to  get 
students  to  do  this  [participate  in  outreach].  And  although,  undoubtedly, 
they  benefited  the  kids  in  the  classes,  it  was  in  no  way  preparing  people  to 
get  into  high  school  and  elementary  teaching.  The  graduate  students  just 
used  it  as  a  way  of  supporting  themselves.  They  were  interested  in  getting 
a  Ph.D.  and  going  on  with  their  research  careers.  And  I  felt  we  could  make 
better  use  of  the  money. 

This  comment  embodies  the  major  criticism  of  direcf  classroom  enhancemenf 
programs  fhaf  involve  graduafe  sfudenfs:  Whaf  is  fhe  long-ferm  payoff  from 
geffing  graduafe  sfudenfs  who  have  no  inferesf  in  teaching  involved  in  K-12 
classrooms?  Moreover,  fhese  commenfs  suggesf  fhaf,  fo  get  faculty  to  be  more 
supportive  of  educafion  oufreach  programs,  fhere  has  fo  be  a  clearer 
undersfanding  of  fhe  long-ferm  goal.  Science  faculfy  af  Research  I  universities  are 
driven  toward  producing  research  and  research  producfs.  Programs  and 
acfivifies  fhaf  are  nof  in  line  wifh  fhaf  focus  are  perceived  as  liabilifies.  As 
oufreach  programs  consider  ways  fo  gef  more  faculfy  supporf,  fhey  may  explore 
ways  fo  align  fheir  programs  wifh  research  producfivify. 


Turf  Issues  Between  Education  and  Science  Faculty 

As  mentioned  earlier,  many  of  fhe  programs  involved  some  form  of  collaborafion 
befween  educafion  and  science  faculfy.  And  alfhough,  fhis  was  a  positive  long- 
ferm  sfrafegy,  several  commenfs  suggesfed  fhaf  bringing  fhese  fwo  deparfmenfs, 
who  were  often  on  differenf  sides  of  fhe  fence,  fogefher  presented  many 
challenges.  Many  program  directors  acknowledge  fhaf  fhere  are  often  furf  issues 
befween  schools  of  educafion  and  fhe  physical  sciences  fhaf  made  if  challenging 
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for  faculty  from  these  two  groups  to  work  together.  Regarding  recruitment  and 
training  of  university  science  students,  the  primary  challenge  between  these  two 
groups  centered  on  the  emphasis  on  content  knowledge  versus  pedagogical 
training.  One  of  the  program  directors  explained  the  difference  this  way: 

The  science  community  feels  that  education  in  depth,  in  the  subject  matter, 
is  essential  if  the  teacher  is  to  be  able  to  have  some  perspective  and 
recognize  that  there  are  shortages  in  what  he  or  she  is  teaching,  especially 
in  a  reform  context.  But  obviously  just  having  the  content  knowledge 
doesn't  make  you  a  good  teacher,  and  that  goes  without  saying.  But  it's 
necessary.  And  now  there  is  tension  between  people  in  mathematics  who 
are  involved  in  the  program  and  people  in  education. 

Other  challenges  centered  on  the  involvement  of  preservice  teachers  in  outreach 
programs.  Although  many  education  people  viewed  this  as  a  logical  extension  of 
teacher-preparation  programs,  science  faculty  were  reluctant  to  recruit  students 
who  did  not  have  the  grounding  in  science  content: 

We  have  had  some  difficulty  getting  the  education  department  to  connect 
to  what  we're  doing.  We  have  some  differences  here.  If  these  folks 
[education  students]  are  going  to  be  teaching  anyway,  then  we  should  get 
them  as  a  preservice  fimction  and  get  them  involved.  Now  they  may  not 
have  as  much  science  content  as  a  science  person,  but  why  not  give  them 
this  experience.  It's  not  a  conflict,  it's  just  a  difference  in  emphasis. 

Despite  these  challenges,  collaboration  with  schools  of  education  was  critical  to 
the  success  of  many  of  these  programs.  In  addition  to  providing  pedagogical 
training  for  the  graduate  and  undergraduate  science  students,  some  programs 
used  student-teacher  interns  to  accompany  science  students  into  classrooms  as 
part  of  their  training.  In  many  instances,  visible  support  and  involvement  from 
schools  of  education  gave  outreach  programs  more  credibility  in  the  eyes  of  the 
K-12  schools.  One  program  coordinator  explained  the  importance  of 
collaborations  with  schools  of  education: 

The  district  liked  that  we  were  bringing  in  the  School  of  Education  also.  We 
potentially  represent  not  only  direct  resources  to  them,  but  direct  resources 
for  improving  the  pipeline. 


Concluding  Thoughts 

We  opened  the  section  by  asking  what  these  programs  offer  universities.  It  seems 
clear  that  these  programs  offered  the  science  graduate  and  undergraduate 
students  an  opportunity  to  reassess  their  learning  and  understanding  of  scientific 
concepts;  a  chance  to  develop  better  communication  skills  by  interacting  with 
people  outside  of  their  community;  and  perhaps  for  some,  an  enriching 
experience  that  gave  them  a  different  cultural  sensitivity  and  awareness.  These 
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may  be  significant  impacts  not  only  for  the  science  students  also  for  the 
universities.  Studies  have  shown  that,  in  the  universities,  as  in  the  schools, 
meaningful  learning  in  science  courses  is  limited  to  a  few  students  who  are 
headed  for  graduate  school,  while  most  other  students  including  most 
prospective  teachers  get  through  their  courses  by  memorization  (see  Anderson, 
1999).  To  the  extent  that  the  outreach  programs  enrich  student  learning  and 
understanding  of  science,  undergraduates  who  participate  in  outreach  may 
benefit  from  these  experiences,  which  reinforce  and  challenge  their  knowledge  of 
science.  These  programs  may  also  increase  undergraduate  enrollment  in  science 
courses  and  may  increase  the  number  of  science  majors  at  universities. 

It  is  more  difficult  to  assess  the  significance  of  these  impacts  for  graduate 
students.  Further  research  would  be  necessary  to  determine  whether  the 
experience  of  working  with  K-12  schools  improved  their  skills  as  teaching 
assistants,  helped  them  think  through  and  articulate  their  research  to  others,  or 
even  had  long-term  impacts  on  their  ability  to  teach  introductory  science  courses 
as  future  faculty.  In  terms  of  overall  benefits  to  the  university,  the  improved 
community  relations  seemed  to  be  important  to  the  program  directors,  and  many 
felt  that  this  could  be  used  as  a  selling  point  in  discussions  with  deans  and  other 
administrative  staff  about  the  importance  of  outreach. 

Challenges  from  the  higher-education  culture  primarily  stem  from  the  reward 
systems  at  most  universities,  which  place  high  priority  on  scholarly  research  and 
research  products.  In  this  environment,  activities  that  take  time  from  research  are 
often  viewed  as  liabilities.  Thus,  outreach  programs  that  utilize  science  graduate 
and  undergraduate  students,  a  valuable  workforce  in  universities  (particularly 
Research  I  universities)  face  increased  scrutiny.  We  found  this  to  be  particularly 
true  of  the  direct  classroom  enhancement  programs.  Of  the  different  types  of 
programs  we  visited,  these  were  viewed  with  the  most  skepticism  from 
university  faculty,  who  were  less  inclined  to  support  this  method  of  outreach. 
Unlike  the  teacher  researcher  programs,  which  allowed  graduate  students  to 
remain  in  the  laboratory  and  work  with  teachers,  direct  classroom  enhancement 
programs  required  graduate  students  to  work  outside  the  research  arena  and 
immerse  themselves  completely  in  teaching  in  a  different  culture,  which  had 
little,  if  anything,  to  do  with  research.  Many  science  faculty  questioned  not  only 
the  purpose  of  these  programs  for  K-12  schools  but  also  the  long-term  impacts  of 
these  programs  on  the  schools.  While  these  are  difficult  questions  to  answer,  they 
do  point  to  some  of  the  core  issues  that  must  be  addressed  if  outreach  programs 
are  to  be  integrated  into  universities. 

Challenges  from  the  university  also  arise  from  some  of  the  pedagogical  issues 
these  programs  faced.  Training  for  both  science  students  and  teachers  seems  to 


54 


be  a  critical  component  of  success,  particularly  for  fhe  direcf  enhancement 
programs  that  place  science  students  in  the  classrooms.  Despite  their  intended 
role  of  supporf,  fhe  presence  of  science  sfudenfs  in  fhe  classroom  means  fhaf  fhey 
are  influencing  learning.  For  fhis  reason,  fraining  in  pedagogical  skills  aimed  af 
effective  mefhods  of  communicafing  scienfific  concepfs  is  crucial.  Moreover,  for 
feachers  who  are  ufilizing  fhe  confenf  knowledge  fhaf  science  sfudenfs  bring  fo 
fheir  classrooms,  fraining  is  necessary  fo  ensure  fhaf  fhe  feachers  use  fhis 
resource  in  fhe  mosf  appropriafe  manner.  Pedagogical  fraining  would  enable 
bofh  K-12  sfudenfs  and  feachers  fo  derive  fhe  maximum  benefits  of  having 
science  sfudenfs  in  fhe  classrooms  as  resources.  Furfhermore,  fhe  science 
graduafe  and  undergraduafe  would  also  benefif  from  coursework  or  fraining 
fhaf  would  emphasize  communicafion  skills  and  mefhods  of  explaining  scienfific 
concepfs.  Indeed,  for  many  science  graduafe  sfudenfs,  improving  communicafion 
skills  was  fhe  key  reason  dfed  for  parficipafion  in  oufreach  programs  and 
pedagogical  fraining  may  serve  fo  affracf  more  sfudenfs  fo  fhese  programs. 
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5.  Summary  and  Conclusions 


This  section  addresses  the  third  research  question  of  this  study  and  begins  with  a 
discussion  of  some  of  fhe  feafures  fhat  enabled  programs  fo  effecfively  address 
fhe  challenges  mentioned  in  fhe  previous  sections.  The  following  subsection 
summarizes  implications  of  the  study,  and  the  section  ends  with  a  discussion  of 
issues  for  furfher  research. 


Shared  Characteristics  Among  Outreach  Programs 
Suggest  Recipe  for  Success 

All  fhese  programs  shared  a  common  record,  by  some  measures,  of  success.  All 
were  able  fo  perform  effecfively  and  fo  creafe  a  funding  and  supporf  base  fo 
ensure  fheir  continued  operation.  In  shorf,  fhe  parficipants  we  inferviewed 
perceived  fhe  programs  to  be  both  sustainable  and  effective.  In  this  subsection, 
we  discuss  the  common  characteristics  of  fhe  oufreach  programs  fhaf  confribufed 
fo  fheir  success,  which  include  shared  vision,  personnel,  sfrafegic  planning, 
supporf  infrasfrucfure,  and  locality. 


Shared  Vision 

Outreach  programs  require  an  extraordinary  amount  of  supporf  and  dedication 
from  program  parficipanfs.  Conversations  with  program  directors,  coordinators, 
and  managers  indicated  that  a  critical  part  of  gaining  fhis  dedicafion  is  a  shared 
vision  of  fhe  imporfance  of  fhe  oufreach  program.  The  vision  is  imporfanf 
because  if  serves  to  inspire  and  unite  program  participants  from  diverse 
backgrounds.  For  many  of  fhe  oufreach  programs  we  visifed,  linking  efforfs  fo 
improve  science  education  fo  a  larger  sociefal  aim  was  critical.  For  example, 
some  viewed  improving  science  education  in  underserved  communities  as  being 
a  way  to  contribute  to  efforts  to  achieve  social  justice,  and  it  was  this  vision  of 
social  justice  fhaf  creafed  the  need  to  improve  science  education.  Similarly  for 
ofher  programs,  a  vision  of  a  universify  fhaf  is  nof  disconnecfed  from  the  ills  of 
sociefy  surrounding  fhem,  buf  is  insfead  commiffed  fo  using  fhe  resources  in  fhe 
universities  for  change  provided  the  basis  for  developing  an  oufreach  program 
focused  on  improving  science  education.  If  was  imporfanf  fhaf  fhis  vision  was 
broad  enough  so  fhaf  others  outside  of  fhe  scientific  and  educafional 
communities  could  rally  around  if  and  provide  supporf.  Shared  vision  was  a 
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critical  component  for  overcoming  challenges  related  to  lack  of  buy-in  from 
universify  faculfy,  deans,  and  ofher  adminisfrafive  officials. 


Personnel 

Frequenfly,  fhe  success  of  many  of  fhese  programs  was  described  as  fhe  resulf  of 
fhe  "sheer  will"  of  exfremely  passionafe  people.  In  our  inferviews,  phrases  like 
"This  program  would  nof  happen  if  nof  for  Dr.  X"  or  "fhe  success  of  fhis 
program  is  due  fo  X"  were  common.  Many  inferviewees  sfafed  fhaf  programs 
and  efforfs  like  fhis  could  nof  be  replicafed  wifhouf  fhe  involvemenf  of  cerfain 
key  individuals.  In  facf,  fhe  ferm  magicians  was  used  fo  describe  fhese  all- 
imporfanf  individuals  who  were  able  fo  make  fhings  happen  seemingly  ouf  of 
fhin  air.  Each  program  had  a  magician,  and  we  were  able  fo  idenfify  similar 
characferisfics  among  fhese  individuals  fhaf  made  fhem  sfand  ouf.  Typically, 
fhese  individuals  were 

•  senior  faculfy 

•  familiar  wifh  fhe  infricacies  of  fhe  universify  sysfem  and  undersfood  how  if 
worked 

•  viewed  as  eminenf  in  fheir  discipline 

•  nof  concerned  wifh  mainfaining  fhe  sfafus  quo. 

This  lisf  does  nof  imply  fhaf  individuals  wifhouf  fhese  characferisfics  cannof 
confribufe  fo  a  successful  program,  buf  fhe  consisfency  of  fhese  four 
characferisfics  across  all  fhe  oufreach  programs  we  visifed  underscores  fheir 
imporfance.  The  firsf  feafure,  seniorify,  is  a  key  elemenf  in  leading  oufreach 
programs.  One  program  direcfor  suggesfed  fhaf  junior  faculfy  would  be  ill- 
advised  fo  fry  fo  run  an  oufreach  program: 

You  have  to  get  yourself  established  as  to  why  you  were  hired  in  the  first 
place.  To  put  an  assistant  professor  on  a  very  prestigious  or  important 
academic  committee  with  a  heavy  workload  would  be  a  disservice  to  the 
person  and  to  the  committee. 

The  importance  of  undersfanding  fhe  universify  sysfem  and  how  if  works  is 
importanf  in  gaining  universify  supporf  for  fhese  programs.  Understanding  the 
proper  channels  to  go  through  can  help  increase  the  visibility  of  fhese  programs 
fo  influenfial  people.  Having  credibilify  and  respecf  among  one's  peers  is  an 
importanf  elemenf  in  elicifing  supporf  from  ofher  faculfy  and  high-level 
personnel.  As  suggesfed  in  fhe  earlier  quofe,  esfablishing  oneself  as  a  credible 
researcher  is  critical.  All  fhese  affribufes  are  imporfanf  for  fhe  lasf  characferisfic 
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listed.  Lack  of  concern  with  maintaining  the  status  quo  tends  to  give  these 
leaders  a  "trailblazer"  persona  and  is  absolutely  essential  for  real  reform.  Too 
often,  outreach  programs  devolve  into  "feel-good"  programs  that  do  no  harm 
but  also  little  good.  A  willingness  to  go  beyond  feel  good  attempts  at  outreach  is 
important  for  programs  like  this  to  be  successful.  As  one  program  director  stated, 
"Any  program  like  this  always  requires  somebody  who  is  willing  to  say  T  want 
this  to  happen  and  1  will  see  to  it  that  it  does  happen.'" 

Along  with  strong  leadership,  it  is  also  important  to  have  productive 
partnerships.  Although  the  "trailblazer"  may  be  successful  in  the  higher- 
education  culture,  he/  she  may  not  be  well-suited  for  the  negotiations  that  take 
place  in  school  districts.  Within  many  of  these  programs,  we  identified  a 
partnership  between  a  senior  program  director  and  a  community  liaison.  The 
community  liaison  is  generally  a  person  who  is  part  of  the  university  but  has  had 
experience  in  the  K-12  world  that  gives  him/her  the  insight  necessary  to  be 
effective  in  dealing  with  schools  and  districts. 


Strategic  Planning 

Perhaps  the  most  critical  aspect  in  the  success  of  many  of  these  programs  was 
having  the  time  and  resources  necessary  for  strategic  planning.  Most  programs 
were  initially  supported  on  small  budgets,  with  a  few  dollars  here  and  there,  but 
with  lots  of  freedom  and  flexibility  for  strategic  planning.  Most  program 
directors  felt  that  by,  starting  off  small,  they  had  the  ability  to  construct  the 
programs  they  way  they  wanted  to,  without  having  to  deal  with  "the  strings  that 
are  often  attached"  to  federal  or  private  funding.  This  also  meant  they  had  the 
time  to  select  the  appropriate  personnel  and  build  a  solid  base  of  trust  between 
the  university  and  the  schools  that  they  were  working  with.  For  those  whose 
programs  were  initiated  with  federal  funding,  the  urgency  to  get  things  going 
often  meant  that  planning  was  more  reactive  than  strategic.  Many  program 
directors  felt  that,  if  there  had  been  one  factor  that  could  have  improved  the 
program,  it  would  have  been  more  time  for  planning. 


Support  Infrastructure 

Seeking  support  from  a  wide  range  of  participants  is  important  in  tapping  into 
different  resources.  Frequently,  these  resources  can  be  found  in  other  university 
departments.  For  example,  many  sociology,  psychology,  and  ethnic  studies 
departments  have  also  participated  in  different  forms  of  outreach  and  can  offer 
comments  and  suggestions  about  making  inroads  into  district  communities. 
Partnerships  with  schools  of  education  are  perhaps  the  most  critical  support 
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resource  to  develop.  Responsible  for  preparing  future  generations  of  teachers, 
schools  of  education  offer  a  natural  way  to  connect  the  science  content  with  the 
pedagogical  training.  More  than  that,  partnerships  with  schools  of  education  give 
outreach  programs  a  measure  of  credibility  because  they  represent  a  potential 
investment  in  the  community.  Districts  often  view  the  transient  nature  of  the 
outreach  programs  utilizing  university  students  negatively;  however,  many 
schools  viewed  the  presence  of  science  graduate  students  partnered  with 
preservice  interns  in  their  schools  as  a  potential  long-term  investment. 


Locality 

Outreach  programs  where  the  universities  were  situated  near  or  in  the 
community  with  the  partnering  K-12  schools  shared  a  common  bond  based  on 
proximity.  Problems  and  issues  within  the  community  affected  both  the 
university  and  the  K-12  schools,  and  this  created  a  much  stronger  bond  between 
them.  Moreover,  the  convenience  of  being  able  to  walk  to  the  schools  should  not 
be  underestimated.  Other  programs  that  were  located  away  from  the  schools 
they  partnered  with  found  that  transportation  issues  created  quite  a  hurdle. 


Implications  of  Study 

This  research  was  designed  to  spotlight  a  small  subset  of  programs  and  raise 
issues  for  further  exploration.  Thus,  before  any  policy  recommendations  can  be 
made,  future  research  aimed  at  verifying  and  validating  the  results  of  this  study 
must  be  done.  However,  we  believe  that  a  number  of  important  issues  emerged 
from  this  study.  One  of  the  major  ideas  is  an  understanding  of  the  different  ways 
outreach  programs  impact  student  learning.  Improving  student  learning  in 
science  and  math  requires  different  things  in  different  classrooms,  for  different 
students.  A  single  outreach  program  cannot  provide  all  of  the  resources  needed 
to  improve  science  and  math  learning  in  K-12  classrooms.  However,  good 
outreach  programs  can  support  classrooms  and  provide  the  necessary 
infrastructure  to  ensure  that,  while  schools  are  in  the  process  of  change,  student 
learning  in  science  and  math  is  not  compromised.  As  schools  work  on 
developing  more-rigorous  science  and  math  curriculums,  attracting  and 
retaining  teachers  with  strong  backgrounds  in  math  and  science,  and  creating 
instructional  activities  aimed  at  engaging  students  of  all  backgrounds,  science 
graduate  and  undergraduate  students  can  serve  as  an  important  tool  to  aid  and 
expedite  that  process. 

Another  idea  that  emerged  from  the  study  is  an  awareness  of  the  impact  of  high- 
stakes  testing  in  math  and  reading  on  science  instruction.  At  a  time  when  the 
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National  Science  Education  Standards  are  demanding  that  teachers  develop  a  set 
of  sophisticated  and  complex  skills  for  feaching  science,  fhe  amounf  of  fhe  time 
fhaf  classrooms  spend  on  science  insfrucfion  may  be  limifed  as  a  resulf  of  fhe 
emphasis  on  high-sfakes  fesfing.  Our  inferviews  suggesfed  fhaf  fhese  conflicfing 
goals  creafe  a  number  of  challenges  for  feachers,  and  in  fhis  environmenf, 
oufreach  programs  fhaf  utilize  universify  sfudenfs  may  be  an  appropriafe  and 
much-needed  resource  fo  help  resolve  fhis  fension. 

This  sfudy  also  suggesfed  fhaf,  fo  be  successful,  oufreach  programs  musf 
negofiafe  fhe  barriers  and  obsfacles  presenf  in  bofh  K-12  schools  and  insfifufions 
of  higher  educafion.  Figure  5.1  provides  a  schemafic  diagram  of  fhese  fwo 
culfures  and  illusfrafes  some  of  fhe  challenges  wifhin  each  culfure.  As  shown, 
universify  science  sfudenfs  represenf  the  input  from  higher  educafion  being 
ufilized  fo  supporf  feachers  in  fheir  efforfs  fo  improve  science  learning  in  K-12 
classrooms.  As  such,  universities  are  responsible  for  bofh  fhe  quanfify  and 
qualify  of  fhe  science  undergraduafe  and  graduafe  sfudenfs  on  which  fhese 
programs  depend.  Thus,  fhe  supporf  of  insfifufions  of  higher  educafion  is  crifical 
fo  fhe  success  of  these  programs.  It  is  difficult  for  oufreach  programs  fo  be  eifher 
susfainable  or  effective  wifhouf  a  sfeady  supply  of  qualified  science  sfudenfs. 


K-12  classroom  RAND/wR)«e-5.f 


Figure  5.1 — A  Systems  View  of  Outreach  Programs 
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The  four  nodes  within  the  higher-education  box  represent  the  challenges  that 
were  discussed  in  Section  4.  While  all  these  challenges  potentially  impact  the 
input,  the  most  critical  is  perhaps  the  emphasis  on  research  and  research 
products  at  most  universities.  One  could  argue  that  this  emphasis  in  fact  drives 
the  creation  of  the  other  challenges.  Consequently,  getting  and  maintaining 
support  from  the  university  is  an  important  objective  for  outreach  programs. 
Without  university  support,  few  programs  can  be  sustained  for  long;  eventually, 
a  lack  of  support  will  undermine  their  effectiveness  in  K-12  classrooms.  This  lack 
of  support  from  science  faculty,  the  lack  of  emphasis  on  the  importance  of 
developing  good  teaching  skills,  and  potential  concerns  about  increasing  the  time 
it  takes  for  graduate  students  to  obtain  their  doctoral  degrees  are  all  factors  that 
affect  the  future  recruitment  and  participation  of  graduate  students  and,  to  a 
lesser  extent,  undergraduate  students. 

On  entering  the  K-12  school  culture,  university  science  students  confront  a 
number  of  challenges  that  affect  their  ability  to  support  teachers'  efforts  to 
improve  science  learning.  The  nodes  in  the  box  labeled  "K-12  classrooms" 
highlight  many  of  the  challenges  discussed  in  Section  3.  While  challenges  in  the 
higher-education  culture  essentially  stem  from  an  emphasis  on  research,  the 
challenges  in  the  K-12  world  are  quite  divergent,  and  the  factors  that  create  and 
influence  them  vary  tremendously.  For  example,  increasing  district  support  for 
outreach  programs  may  increase  the  focus  on  student-centered  learning; 
however,  other  issues,  such  as  motivation  to  learn  and  the  emphasis  on  math  and 
literacy  skills,  still  to  challenge  the  effectiveness  of  these  programs. 

Ironically,  the  net  effect  of  the  challenges  in  both  cultures  is  the  same:  Science 
education  is  being  squeezed  out  and  given  less  attention.  Both  cultures  have  a 
number  of  obstacles  to  emphasizing  and  teaching  science  in  a  meaningful  way.  In 
the  K-12  world,  the  competing  priority  of  high-stakes  testing  in  math  and 
reading  often  contributes  to  the  lack  of  attention  to  science  education.  In  the 
higher-education  culture,  the  emphasis  on  research  can  often  result  in  the 
devaluation  of  science  teaching  and  education  in  the  university  system. 

This  study  also  raises  the  issue  of  incentives  for  the  participation  of  universities 
in  outreach  programs.  The  dashed  arrow  in  Figure  5.1  indicates  that  there  is  a 
critical  feedback  loop  from  K-12  schools  to  the  institution  of  higher  education 
that  needs  further  development.  The  study  suggests  that  creating  incentives  for 
universities  to  participate  in  outreach  is  critical  to  the  sustainability  of  these 
programs,  and  program  directors  and  coordinators  should  pay  attention  to  the 
unique  attributes  of  the  partnerships  between  universities  and  K-12  schools. 
Certainly,  one  area  worth  pursuing  is  the  in-depth  learning  that  many  graduate 
students  reported  as  a  result  of  interacting  with  K-12  teachers  and  students. 
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Community  support  for  the  universities  is  another  important  benefit,  especially 
to  universities  located  near  the  K-12  schools  they  partner  with.  Moreover, 
universities  might  consider  using  faculty  research  (when  appropriate)  as  a 
method  of  supplementing  K-12  curriculum  maferials.  Nof  only  would  fhis 
provide  K-12  sfudenfs  wifh  customized  and  modern  science  fopics  for 
discussion,  if  could  also  be  used  as  a  basis  for  getting  more  "buy-in"  from  fhe 
science  faculfy. 


Issues  for  Future  Study 

This  sfudy  suggesfs  several  areas  of  research  fhaf  deserve  furfher  affenfion, 
including  areas  include  program  design,  evaluafion,  and  implemenfafion  issues. 
Building  on  fhe  ideas  presenfed  in  Figure  5.1,  fhe  schemafic  in  Figure  5.2 
illusfrafes  where  these  issues  are  located.  For  example,  a  number  of  program- 
design  issues  emerge  from  fhe  links  befween  fhe  higher-educafion  culfure  and 
fhe  K-12  classrooms;  implemenfafion  issues  emerge  from  fhe  challenges  fhaf 


RAHDMR1446-5.2 

Program  design 

issues  K-12  classroom  Program 


Figure  5.2 — ^Program  Design,  Evaluation,  and  Implementation 
Issues  in  Outreach  Programs 
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program  participants  identified;  and  evaluation  issues  are  embedded  in  the 
discussion  on  the  outcomes  and  impacts  of  fhese  programs. 


Program  Design  Issues 

Targefing  fhe  needs  of  fhe  K-12  schools  in  fhe  mosf  appropriafe  and  effective 
manner  is  an  imporfanf  issue  in  program  design.  The  programs  fhaf  we  have 
discussed  in  fhis  reporf  represenf  a  specfrum  of  differenf  infervenfion  efforfs  fhaf 
range  from  fhose  fhaf  require  liffle  classroom  confacf  (e.g.,  remofe  classroom 
enhancemenf  programs)  fo  fhe  fhose  fhaf  involve  more  susfained  classroom 
inferacfion  (e.g.,  direcf  classroom  enhancemenf).  Thus,  one  sfrafegy  for  fargefing 
school  needs  effectively  would  be  fo  develop  a  universify-based  program  fhaf 
confains  a  porffolio  of  differenf  infervenfion  approaches  for  parfnering  fhe 
falenfs  and  skills  of  uni  versify  sfudenfs  wifh  K-12  classrooms.  This  would  allow 
ouf reach  programs  more  flexibilify  in  coordinating  fheir  efforfs  wifh  K-12 
schools.  For  example,  rafher  fhan  sfarfing  ouf  wifh  direcf  enhancement 
programs,  K-12  schools  and  universities  might  elect  to  begin  working  together 
through  remote  enhancement  programs  in  which  graduate  students  interact  via 
the  Internet.  If  more  supporf  is  needed  over  fime,  fhe  frusf  and  camaraderie  fhaf 
have  been  builf  from  a  noninfrusive  mefhod  of  supporf  can  be  used  fo  "smoofh 
fhe  way"  in  developing  more-infensive  mefhods  of  oufreach.  Combining  efforfs 
under  a  single  program  would  also  allow  program  direcfors  fo  focus  on 
developing  effective  ways  fo  ufilize  fhe  falenfs  of  universify  science  sfudenfs. 

Alfhough  having  graduafe  sfudenfs  available  via  e-mail  may  represenf  a  "drop 
in  fhe  reform  buckef"  for  some  schools,  fhis  infervenfion  may  be  all  fhaf  is 
needed  for  some  classroom  feachers  fo  become  more  confidenf  and  creafive  in 
fheir  science  insfrucfion.  However,  if  more-infensive  efforfs  are  needed,  such  as 
placing  sfudenfs  in  classrooms,  fhese  programs  could  use  fhe  infrasfrucfure  fhaf 
has  been  developed  for  less  infensive  efforfs  fo  creafe  more  exfensive  nefworks 
wifh  K-12  schools  and  could  prepare  graduafe  sfudenfs  fo  enfer  info  K-12 
classrooms  wifh  sound  fraining  in  science  educafion.  These  programs  could  also 
research  and  explore  alfernafive  design  sfrafegies  utilizing  graduafe  and 
undergraduafe  sfudenfs.  Graduafe  sfudenfs  are  an  expensive  infervenfion,  and 
sfrafegies  fhaf  mix  undergraduafe  sfudenfs,  and  preservice  feachers  may  creafe 
cosf-effecfive,  as  well  as  pedagogically  sound,  ways  of  increasing  fhe  impacf  of 
universify  sfudenfs  visifing  schools. 

These  programs  could  also  begin  fo  creafe  pafhways  fhaf  address  fhe  need  fo 
bring  sfudenfs  wifh  sfrong  science  and  mafh  backgrounds  info  feaching 
professions.  Subjecf-maffer  knowledge  is  imporfanf  in  feaching  because  if  affecfs 
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the  confidence  that  teachers  bring  to  the  subjects  they  teach  and  their  ability  to  be 
creative  in  developing  curriculum.  Because  many  of  these  programs  focus  on 
recruiting  students  with  aptitude  in  science  and  math,  they  may  offer  a  way  to 
channel  students  into  teaching  careers. 

This  study  also  suggests  that  program  design  should  build  in  more  incentives  for 
the  universities.  A  number  of  ideas  were  mentioned  in  Section  4,  and  further 
research  could  be  done  to  identify  which  incentives  would  be  most  beneficial  to 
universities. 


Evaluation  Issues 

Clearly,  the  issue  of  evaluation  needs  to  be  dealt  with.  A  better  understanding  is 
needed  of  what  it  is  these  programs  are  actually  doing.  Program  directors 
explained  to  us  that  the  project  budgets  do  not  provide  for  rigorous  evaluation 
efforts.  Consequently,  evaluation  strategies  are  not  part  of  the  original  project 
designs.  Moreover,  because  outreach  programs  are  often  part  of  larger  science 
research  grants,  the  effectiveness  of  the  education  outreach  component  has  little 
impact  on  continued  or  renewed  grant  support.  While  many  of  the  programs  we 
visited  had  some  form  of  evaluation,  most  of  the  evaluations  were  designed  to 
improve  various  features  of  the  program  rather  than  to  determine  how  well  the 
program  was  achieving  its  stated  goals  and  objectives.  Evaluation  is  a  critical 
part  of  the  success  of  these  programs,  and  stronger  incentives  for  high-quality 
and  continuous  evaluation  need  to  be  created.  Although  looking  at  student 
achievement  in  math  and  science  is  important,  these  evaluations  should  be 
sensitive  to  the  multidimensional  aspects  of  the  programs  and  should  be  geared 
to  detect  what  these  programs  are  doing,  such  as  increasing  student  motivation 
and  enthusiasm  for  science,  increasing  teacher  collegiality,  changing  teacher 
practices,  and  changing  teacher  attitudes  toward  science.  As  stated  in  Section  3, 
one  of  the  primary  contributions  of  the  science  students  was  their  ability  to 
facilitate  immediate  changes  in  teacher  attitudes  and  teaching  practices.  If  these 
programs  are  viewed  in  light  of  facilitating  change  rather  than  producing  change, 
the  metrics  should  focus  on  measuring  the  changes  in  classroom  conditions  and 
school  environments. 

Moreover,  the  evaluations  should  also  measure  impacts  on  the  higher-education 
side.  Improved  communication  in  science,  increased  enrollment  in  science 
courses  as  a  result  of  adding  an  outreach  component  to  traditional  science 
classes,  and  a  deeper  awareness  and  understanding  of  societal  issues  were  all 
mentioned  as  important  impacts  in  this  study,  and  future  research  should  focus 
on  how  to  measure  these  impacts.  Strong  evaluations  that  measure  impacts  on 
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both  the  K-12  classroom  and  the  university  science  students  could  move  these 
outreach  activities  from  peripheral  programs  to  integral  components  of  fhe 
universify  because  fhey  would  be  viewed  as  having  measurable  positive  impacfs 
on  fhe  graduafe  sfudenfs  fhaf  parti cipafe  in  fhem,  as  well  as  on  fhe  K-12  sfudenfs 
and  feachers. 


Implementation  Issues 

Many  of  fhe  major  implemenfafion  issues  are  cenfered  on  fhe  personal 
relationship  befween  fhe  universities  and  fhe  schools.  Getting  buy-in  from 
schools  and  disfricfs  for  oufreach  programs  hinges  on  building  mufual  frusf  and 
respecf  befween  universifies  and  schools.  Developing  frusf  fakes  fime.  For  some 
programs,  one  year  is  all  fhaf  is  needed  fo  make  connecfions  and  build 
relationships;  for  ofhers,  if  may  fake  longer.  And  yef,  fhe  foundation  for 
successful  implemenfafion  depends  on  fhis  key  ingredienf.  Many  inferviewees 
sfafed  fhaf  a  lack  of  fime  creafed  a  number  of  implemenfafion  challenges  early  in 
fhe  process.  Building  a  planning  period  info  fhe  sfrucfure  of  fhe  sponsoring  granf 
may  be  one  way  fo  address  fhis  issue  and  was  suggesfed  by  a  number  of 
program  parficipanfs. 

Ofher  implemenfafion  issues  sfem  from  disjoinfed  efforfs  among  program 
parficipanfs,  and  having  a  single  coordinafed  efforf  is  crucial.  As  one  program 
direcfor  described. 

Although  any  one  of  us  individually  could  step  out  into  the  surrounding 
area,  into  the  schools,  we  would  run  into  various  brick  walls,  social 
context,  political  context,  and  there  are  all  sorts  of  things  you  don't 
understand.  At  some  point  you  are  all  on  the  same  side,  you  want  students 
to  learn  science  and  math  better,  but  there's  all  this  subtext,  and  the 
coordinated  effort  helps  people  get  around  that. 

Programs  that  were  able  to  coordinate  their  efforts  through  community 
partnerships  were  able  to  be  much  more  effective  in  connecting  to  K-12 
classrooms  and  building  sustainable  long-term  relationships. 

This  study  also  suggests  that  the  characteristics  of  fhe  universify  culfure  are 
critical  fo  implemenfafion  and  should  be  considered  carefully.  Universifies  wifh 
a  sfrong  emphasis  on  research  presenf  a  number  of  implemenfafion  challenges. 
Program  direcfors  should  consider  universifies  whose  missions  encompass  many 
of  fhe  goals  of  fhe  oufreach  programs.  Stafe-supporfed  colleges  and/or 
historically  minorify  universifies  wifh  long  hisfories  of  communify  oufreach  may 
have  sfronger  incenfives  fo  parti  cipafe  in  oufreach  programs,  as  well  as  an 
infrasfrucfure  fhaf  more  easily  accommodates  parfnerships  wifh  K-12  schools. 
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Finally,  this  study  suggests  that  implementing  outreach  programs  that  involve 
science  university  students  is  inherently  difficult.  Therefore,  supporting  and 
expanding  existing  parfnerships  (wifh  a  sef  of  "successful"  characferisfics)  may 
be  more  cosf-effective  fhan  creating  new  programs. 
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Appendix 

A.  Interview  Protocols 


This  appendix  contains  the  interview  protocol  we  used  on  our  site  visits  to 
universities  and  K-12  schools.  We  used  the  teacher  interview  protocol  for  K-12 
classroom  teachers  we  interviewed.  The  scientist  interview  protocol  was  used  for 
inferviews  wifh  undergraduafe  and  graduafe  sfudenfs.  For  inferviews  wifh 
program  direcfors,  coordinafors  and  managers,  we  used  fhe  program 
adminisfrafor  inferview  profocol. 


Teacher  Interview  Protocol 

Ql:  To  gef  fhings  sfarfed,  lef's  go  around  fhe  room.  Td  like  a  brief  explanafion 

of  whaf  led  fo  your  participation  in  the  XXX  program. 

PI:  Were  there  any  incentives  (explicit  or  implicit)  provided? 

Q2:  Do  you  feel  fhaf  you  benefif  from  your  parficipafion  in  fhe  program? 

PI:  If  so,  how? 

Q3:  Has  your  experience  in  fhis  program  changed  your  classroom  feaching? 

PI:  If  so,  how? 

P2:  As  a  resulf  of  fhis  program,  whaf  sorfs  of  fhings  will  you  emphasize 

in  your  classroom  feaching  of  science? 

Q4:  Based  on  your  experience,  whaf  are  fhe  goals  and  objectives  of  fhis 

program? 

Q5:  Did  you  find  inferacfing  wifh  fhe  scienfisfs  useful? 

PI:  If  so,  whaf  aspecf  did  you  feel  was  mosf  useful  in  ferms  of  your 

interacfions  wifh  fhe  scienfisfs? 

Q6:  Did  you  feel  comforfable  inferacfing  wifh  fhe  scienfisfs? 

PI:  Did  you  have  any  challenges  or  difficulties  working  wifh  fhe 

scienfisfs? 

P2:  Have  you  had  direct  interactions  with  the  faculty?  Based  on  your 

experience  do  find  working  wifh  graduafe  and  undergraduafe 
sfudenfs  fo  be  suifable? 

P3:  Why  or  why  not? 
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Q7:  Do  you  expect  to  be  able  to  sustain  the  benefits  from  your  parficipafion  in 

fhis  program? 

PI:  If  so,  how? 

P2:  Would  if  be  helpful  fo  have  more  frequenf  workshops  or 

inferacfions? 

Q8:  Jusf  some  background  quesfions: 

PI:  Whaf  grade  level  do  you  feach? 

P2:  How  much  science  background  have  you  had? 

Q9:  Based  on  your  experience,  does  fhis  program  enhance  science  learning  on 

fhe  parf  of  fhe  sfudenfs? 

PI:  If  so,  how? 

QIO:  Whaf  is  your  overall  assessmenf  of  fhe  program? 

PI:  Whaf  are  some  of  fhe  feafures  you  consider  fo  be  crifical  fo  fhe 

success  of  fhis  program? 

P2:  Whaf  do  you  consider  fo  be  some  of  fhe  shorfcomings  of  fhis 

program? 

P3:  Whaf  changes  would  you  like  fo  make  fo  fhe  program  and  why? 
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Scientist  Interview  Protocol 

Ql:  To  get  things  started,  let's  go  around  the  room.  I'd  like  to  get  a  brief 

explanation  of  whaf  led  fo  your  parficipafion  in  program  XXX. 

PI:  Were  fhere  any  incenfives  (explicif  or  implicif)  provided? 

Q2:  Do  you  feel  fhaf  you  benefif  from  your  parficipafion  in  fhe  program? 

PI:  If  so,  how? 

Q3:  Have  you  had  prior  feaching  experience? 

PI:  If  so,  did  you  find  fhe  experience  of  working  in  fhe  classrooms  fo  be 

differenf? 

P2:  If  so,  how? 

Q4:  Did  you  find  fhere  fo  be  any  unique  challenges  or  difficulfies  in  working 

in  fhe  classrooms? 

PI:  If  so,  whaf  were  fhey? 

P2:  Whaf  sorf  of  adjusfmenfs  did  you  have  fo  make? 

Q5:  Based  on  your  experience,  whaf  are  fhe  goals  and  objecfives  of  fhis 

program? 

Q6:  Whaf  sorf  of  scientific  principles  or  ideas  did  you  fry  fo  emphasize  in  your 

inferacfions  in  fhe  classroom? 

Q7:  Did  you  feel  comforfable  inferacfing  wifh  fhe  feachers? 

PI:  Why  or  why  not? 

Q8:  What  is  your  overall  assessment  of  fhe  program? 

PI:  Whaf  do  you  consider  fo  be  fhe  sfrengfhs  of  fhis  program? 

P2:  Whaf  do  you  consider  fo  be  some  of  fhe  shorf comings  of  fhis 

program? 

P3:  Whaf  changes  would  you  like  fo  make  fo  fhe  program  and  why? 
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Program  Administrator  Interview  Protocol 

Ql:  I'd  like  to  understand  how  the  program  works.  Tell  me  a  little  bit  about 

the  program.  For  example: 

PI:  What  selection  process  do  you  use  for  the  teachers? 

P2:  Are  there  any  particular  groups  of  feachers  fhaf  you  have  fargefed? 

P3:  For  fhe  scienfisfs? 

P4:  How  do  you  mafch  fhe  feacher  wifh  fhe  scienfisf? 

Q2:  Whaf  are  fhe  goals  and  objecfives  of  fhe  program? 

Q3:  Whaf  was  fhe  underlying  mofivafion  for  fhe  program? 

Q4:  Whaf  led  you  fo  creafe  and  implemenf  fhe  program? 

Q5:  Do  you  feel  fhaf  fhis  program  enhances  science  feaching? 

PI:  If  so,  how? 

Q6:  Do  you  feel  fhaf  fhis  program  enhances  science  learning  on  fhe  parf  of  fhe 

sfudenfs? 

PI:  If  so,  how? 

Q7:  How  long  has  fhe  program  been  in  operation? 

Q8:  How  many  feachers  and  scienfisfs  are  normally  involved  in  fhe  program? 

PI:  Has  fhis  changed  over  fime? 

Q9:  Whaf  were  some  of  fhe  challenges  you  faced  in  setting  up  fhis  program? 

QIO:  I  would  be  inferesfed  in  your  overall  assessmenf  of  fhe  program. 

PI:  Whaf  do  you  consider  fo  be  fhe  sfrengfhs  of  fhis  program? 

P2:  Whaf  do  you  consider  fo  be  some  of  fhe  shorfcomings  of  fhis 

program? 

P3:  Whaf  changes  would  you  like  fo  make  fo  fhe  program  and  why? 

P4:  Do  you  have  plans  fo  make  any  changes  fo  fhe  program? 

Qll:  Are  you  conducting  or  planning  any  kind  of  an  evaluation  of  fhe 
program? 

PI:  For  example,  do  you  survey  your  feachers  and  scienfisfs  fo  gef  fheir 

reacfions  and  commenfs? 
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B.  Program  Characteristics 


This  appendix  provides  information  about  each  of  the  outreach  programs  we 
visited.  The  information  for  each  program  was  obtained  from  interview  data, 
program  materials  that  were  given  to  us,  and  Web  site  information. 
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Direct  Classroom  Enhancement  Programs 

PROGRAM  NAME:  DCEl 

PROGRAM  DESCRIPTION:  This  program  brings  graduate  and  undergraduate 
teaching  fellows  together  with  research  scientists  and  in-service  and  preservice 
teachers  to  help  improve  mathematics,  science,  and  technology  education  for 
sfudenfs  in  K-12  school  classrooms. 

PROGRAM  GOALS  AND  OBJECTIVES:  Bringing  science  confenf  info  K-12 
classroom  while  improving  undergraduafe  and  graduafe  education  af  fhe 
universify 

PROGRAM  APPROACH:  Direcf  classroom  enhancemenf 

PROGRAM  FUNDING  SOURCE:  NSF 
PROGRAM  EVALUATION:  None  yet^ 

SCOPE  OF  IMPACT:  6  public  schools^ 

GRADE  LEVEL:  K-12 

SCHOOL  PROFILE:  >88  percenf  African-American  sfudenfs;  more  fhan  86 
percent  of  fhe  pupils  are  from  low  income  families;  all  schools  have  Chapfer  I 
eligibility 

PROGRAM  DURATION:  Academic  school  year  and  summer 

SCHOOL  COMMUNITY:  Urban 

SCIENTIFIC  DISCffLINE^:  Life  sciences,  physical  sciences,  engineering  and 
mafhemafics 

CARNEGIE  CLASSIFICATION  OF  SPONSORING  UNIVERSITY:  Research  I 

NUMBER  OF  PARTICIPATING  SCIENTISTS:  7  graduate  and  17  undergraduate 
fellows 

AMOUNT  OF  TIME  SCIENTISTS  INVOLVED  IN  OUTREACH:  15-20  hrs/week 
COMPENSATION  FOR  SCIENTISTS'  TIME:  Stipend 


^This  information  is  based  on  the  response  to  question  11  in  the  Program  Administrator 
interview  protocol. 

^  Information  about  the  exact  number  of  teachers  and  students  participating  in  this  programs 
was  unavailable  at  the  time  of  interview). 

^Scientific  discipline  refers  to  the  backgrounds  of  the  scientists  that  participated  in  the  outreach 
program. 
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PROGRAM  NAME:  DCE2 

PROGRAM  DESCRIPTION:  Teachers  are  supported  3^  hours  per  week  by 
science  undergraduates.  The  undergraduates  are  trained  at  their  institutions  in 
the  inquiry  approach  to  learning  science. 

PROGRAM  GOALS  AND  OBJECTIVES:  Systemic  conversion  of  elementary 
science  education  to  an  inquiry-centered,  constructivist  approach  through  the  use 
of  kif-based  modules  and  fhe  provision  of  appropriafe  professional 
developmenf — and  classroom  supporf — for  feachers 

PROGRAM  APPROACH:  Direcf  classroom  enhancemenf,  feacher  professional 
developmenf,  insfrucfional  maferials  developmenf^ 

PROGRAM  FUNDING  SOURCE:  NSF 
PROGRAM  EVALUATION:  Yes 

SCOPE  OF  IMPACT:  68  elemenfary  (K-5)  schools;  1,700  feachers  and  35,000 
sfudenfs 

GRADE  LEVEL:  K-5 

SCHOOL  PROFILE:  >92  percenf  African-American  sfudenfs;  over  82  percenf  of 
all  sfudenfs  eligible  for  reduced  lunches 

PROGRAM  DURATION:  Academic  school  year 

SCHOOL  COMMUNITY:  Urban 

SCIENTIFIC  DISCIPLINE:  Life  sciences,  earfh  sciences 

CARNEGIE  CLASSIFICATION  OF  SPONSORING  UNIVERSITY:  Research  I 

NUMBER  OF  PARTICIPATING  SCIENTISTS:  175  undergraduafes 

AMOUNT  OF  TIME  SCIENTISTS  INVOLVED  IN  OUTREACH:  3^  hrs  /  week  in 
classroom 

COMPENSATION  FOR  SCIENTISTS'  TIME:  Universify  credif  hours 


‘^Although  primarily  a  direct  classroom  enhancement  program,  this  program  also  included  other 
components  in  its  outreach  activities  as  well. 
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PROGRAM  NAME:  DCE3 

PROGRAM  DESCRIPTION:  Teams  of  medical,  nursing,  and  public  health 
students  are  recruited  and  trained  to  work  with  school  personnel  to  help 
introduce  heath-science  concepts;  assist  with  in-school,  after-school,  and  summer 
enrichment  activities;  provide  support  and  serve  as  agents  of  change 

PROGRAM  GOALS  AND  OBJECTIVES:  Encourage  K-12  students  to  think 
scientifically  about  health  concerns  and  health  decisions 

PROGRAM  APPROACH:  Direct  classroom  support,  teacher  professional 
development 

PROGRAM  FUNDING  SOURCE:  NIH 

PROGRAM  EVALUATION:  Teachers  complete  forms  to  evaluate  progress  at 
local  schools 

SCOPE  OF  IMPACT:  6  middle  schools,  over  300  students 

GRADE  LEVEL:  6-8 

SCHOOL  PROFILE:  >92  percent  African-American  students;  over  82  percent  of 
all  students  eligible  for  reduced  lunches 

PROGRAM  DURATION:  Academic  school  year 
SCHOOL  COMMUNITY :  Urban 
SCIENTIFIC  DISCIPLINE:  Health  sciences 

CARNEGIE  CLASSIFICATION  OF  SPONSORING  UNIVERSITY:  Research  I 
NUMBER  OF  PARTICIPATING  SCIENTISTS:  43  graduate  students 

AMOUNT  OF  TIME  SCIENTISTS  INVOLVED  IN  OUTREACH:  Minimum  of  6 
hrs  /  month 

COMPENSATION  FOR  SCIENTISTS'  TIME:  Stipend 
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PROGRAM  NAME:  TPl 

PROGRAM  DESCRIPTION:  This  program  provides  math  and  science  majors  a 
full  year  of  intense  observation  and  participation  in  urban  school  classrooms 
during  their  senior  year  and  appropriate  education  courses  during  that  year  and 
the  following  summer.  The  fifth  year  (graduate  level)  consists  of  a  full  year's 
teaching  experience  under  an  emergency  teaching  credential. 

PROGRAM  GOALS  AND  OBJECTIVES:  Interest  prospective  undergraduate 
mathematics  and  science  majors  in  a  school  teaching  career 

PROGRAM  APPROACH:  Teacher  preparation 

PROGRAM  FUNDING  SOURCE:  University  supported  program 

PROGRAM  EVALUATION:  State  evaluation,  surveys,  and  questionnaires  at  the 
end  of  the  program  on  course-level  (at  the  end  of  the  quarter)  and  program-level 
state  credentialing  units  as  well  as  the  university  academic  unit;  students 
evaluate  the  program  at  the  end  of  the  course;  an  ongoing  inquiry  session  is  also 
used  for  evaluation 

SCOPE  OF  IMPACT:  Averages  about  13  students  per  year  matriculating  through 
teacher-preparation  program;  so  far,  has  placed  over  100  hundred  math  majors  in 
schools 

GRADE  LEVEL:  Secondary  and  high  school 

SCHOOL  PROFILE:  Either  (1)  at  least  50  percent  of  the  school's  students  receive 
free  or  reduced  lunch,  and  no  one  racial  group  constitutes  more  than  50  percent 
of  the  total  student  body,  or  (2)  the  school's  student  body  is  majority  Latino, 
African  American,  or  Asian 

PROGRAM  DURATION:  Academic  school  year 

SCHOOL  COMMUNITY:  Urban 

SCIENTIFIC  DISCIPLINE:  Mathematics  and  science  (biology,  chemistry,  and 
physics) 

CARNEGIE  CLASSIFICATION  OF  SPONSORING  UNIVERSITY:  Research  I 
NUMBER  OF  PARTICIPATING  SCIENTISTS:  13  undergraduates 

AMOUNT  OF  TIME  SCIENTISTS  INVOLVED  IN  OUTREACH:  5  hrs  of 

classroom  participation  per  week 

COMPENSATION  FOR  SCIENTISTS'  TIME:  Stipend,  teaching  certification 
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Teacher-Researcher  Programs 

PROGRAM  NAME:  TRl 

PROGRAM  DESCRIPTION:  Teachers  work  with  science  graduate  students  in  a 
research  laboratory  to  learn  about  laboratory  research  and  current  topics  and 
techniques  in  biology.  In  addition  to  the  research  experience,  participating 
teachers  also  have  ongoing  access  to  a  science-kit  loan  program  with  technical 
support. 

PROGRAM  GOALS  AND  OBJECTIVES:  Provide  productive  interaction  between 
individual  science  teachers  and  scientists  in  a  setting  that  provides  hands-on 
experimentation  and  resource  development;  establish  long-term  partnerships 
between  teachers  and  the  scientific  research  community;  and  increase  scientists' 
ability  to  communicate  science 

PROGRAM  APPROACH:  Teacher  professional  developmenf,  insfrucfional 
maferials  developmenf 

PROGRAM  FUNDING  SOURCE:  Howard  Hughes  Medical  Insfifufe  and 
research  cenfer  supporf 

PROGRAM  EVALUATION:  Formal  oufside  evaluation,  parf  of  collaborafive 
mulfisife  sfudy  fo  measure  fhe  impacf  feacher-researcher  programs  have  on 
sfudenfs 

SCOPE  OF  IMPACT:  25  feachers  per  summer,  direcfly  influences  appro ximafely 
3,  750  sfudenfs  annually,  currenfly  over  11,000  sfudenfs  use  kifs 

GRADE  LEVEL:  Middle  school  or  junior  high;  high  school  (5fh-12fh) 

SCHOOL  PROFILE:  77.5  percenf  while,  2.7  percenf  Nafive- American,  6.7  percenf 
Asian,  4.8  percenf  African-American,  8.3  percenf  Hispanic^ 

PROGRAM  DURATION:  2.5  weeks  during  summer;  graduafe  sfudenfs  provide 
ongoing  supporf  fhroughouf  fhe  academic  year 

SCHOOL  COMMUNITY  :  Suburban,  rural,  and  urban 
SCIENTIFIC  DISCIPLINE:  Molecular  biology  and  genetics 

CARNEGIE  CLASSIFICATION  OF  SPONSORING  UNIVERSITY:  Research  I 
NUMBER  OF  PARTICIPATING  SCIENTISTS:  Currenfly  8  graduafe  sfudenfs 

AMOUNT  OF  TIME  SCIENTISTS  INVOLVED  IN  OUTREACH:  Varies,  in  place 
of  leaching  assisfanfship 

COMPENSATION  FOR  SCIENTISTS'  TIME:  Graduafe  sfudenfs  gef  TA  credif 


^Based  on  average  from  1997-1998  state  enrollment. 
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PROGRAM  NAME:  TR2 

PROGRAM  DESCRIPTION:  This  program  engages  secondary  science  teachers  in 
laboratory  research  and  in  the  creation  of  innovative  interactive  curricular 
materials  and  discovery-based  projects. 

PROGRAM  GOALS  AND  OBJECTIVES:  Teachers  will  gain  experience  in  the 
scientific  experimenfafion  process  and  collaborafe  fo  franslate  invesfigafive 
science  acfivifies  info  fheir  classrooms. 

PROGRAM  APPROACH:  Teacher  professional  developmenf 

PROGRAM  FUNDING  SOURCE:  NSF 

PROGRAM  EVALUATION:  Before  and  affer  surveys  of  feacher  and  mentor 
scienfisf  participanfs;  academic  year  meefing  fo  prepare  spring  workshop  for 
fellow  teachers  fo  disseminate  new  curriculum 

SCOPE  OF  IMPACT:  6  teachers  per  summer 
GRADE  LEVEL:  Middle  and  high  schools 

SCHOOL  PROFILE: 

PROGRAM  DURATION:  2-year  cycle  fhaf  includes  fwo  summer  workshops  (Isf 
summer,  6-week  workshop;  2nd  summer,  4-week  workshop)  and  monfhly 
meefings  during  fwo  academic  years 

SCHOOL  COMMUNITY:  Suburban  and  rural 
SCIENTIFIC  DISCIPLINE:  Material  sciences 

CARNEGIE  CLASSIFICATION  OF  SPONSORING  UNIVERSITY:  Research  I 
NUMBER  OF  PARTICIPATING  SCIENTISTS:  6  scientisfs  per  year 

AMOUNT  OF  TIME  SCIENTISTS  INVOLVED  IN  OUTREACH:  Varies 
depending  on  research  projecf 

COMPENSATION  FOR  SCIENTISTS'  TIME:  None— volunfary 
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Remote  Qassroom  Enhancement  Program 

PROGRAM  NAME:  RCl 

PROGRAM  DESCRIPTION:  This  Internet-based  program  enriches  science 
instruction  by  fostering  interactions  between  K-12  students  and  teachers  and 
university  scientists  via  e-mail.  Teachers  and  K-12  students  send  questions  about 
any  area  of  science  fo  scienfisfs  af  fhe  universify,  and  universify  science  sfudenfs 
provide  def ailed  explanations  and  answers. 

PROGRAM  GOALS  AND  OBJECTIVES:  Connecting  universify  scienfisfs  fo  local 
communify  schools,  providing  easy  and  convenienf  accessibilify  fo  confenf 
knowledge  of  scienfisfs 

PROGRAM  APPROACH:  Remofe  classroom  enhancemenf 
PROGRAM  FUNDING  SOURCE:  NSF  and  universify  granf 

PROGRAM  EVALUATION:  Archive  of  all  questions  asked  and  feedback  from 
parficipafing  feachers 

SCOPE  OF  IMPACT:  11  feachers  (  3  elemenfary,  6  junior  high,  and  2  high  school 
feachers) 

GRADE  LEVEL:  Elemenfary,  junior  high,  and  high  school 

SCHOOL  PROFILE:  Sfudenfs  are  from  nearby  ranches  and  farms;  local  economy 
is  based  on  agriculfure;  many  of  fhe  sfudenfs  come  from  migranf  families; 
sfudenf  populafion  is  efhnically  mixed,  wifh  90  percenf  Hispanic,  4  percenf 
Filipino,  3  percenf  whife,  1  percent  black,  2  percent  other 

PROGRAM  DURATION:  Academic  school  year 
SCHOOL  COMMUNITY:  Rural,  migrant  community 

SCIENTIFIC  DISCIPLINE:  Life  sciences,  earfh  sciences,  and  physical  sciences 

CARNEGIE  CLASSIFICATION  OF  SPONSORING  UNIVERSITY:  Research  I 
universify 

NUMBER  OF  PARTICIPATING  SCIENTISTS:  3-4  undergrad,  12  graduafe 
sfudenfs,  and  a  few  posfdocs 

AMOUNT  OF  TIME  SCIENTISTS  INVOLVED  IN  OUTREACH:  Varies 
depending  on  number  of  quesfions  and  level  of  defail  in  scienfific  explanafion 

COMPENSATION  FOR  SCIENTISTS'  TIME:  None— volunfary 
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Instructional  Materials  Development  Program 

PROGRAM  NAME:  IMDl 

PROGRAM  DESCRIPTION:  Undergraduate  students  design,  build,  and  maintain 
instructional  materials  for  science  classroom  instruction. 

PROGRAM  GOALS  AND  OBJECTIVES:  Provides  hands-on  resources  for 
classroom  use  fo  infroduce  sfudenfs  and  feachers  fo  fhe  science  behind 
compufers  and  fiber-opfics  fechnology 

PROGRAM  APPROACH:  Developmenf  of  insfrucfional  materials,  direct 
classroom  support,  professional  developmenf  for  feachers 

PROGRAM  FUNDING  SOURCE:  Inifially  NSF;  currenfly  supporfed  wifh  privafe 
foundation  funding  and  universify  funding 

PROGRAM  EVALUATION:  Teacher  surveys 
SCOPE  OF  IMPACT:  3,500  sfudenfs 
GRADE  LEVEL:  5fh-12fh  grades 

SCHOOL  PROFILE:  80  percenf  Lafino  (agricultural  community);  40  percent  of 
sfudenfs  below  poverty  level 

PROGRAM  DURATION:  Academic  school  year 
SCHOOL  COMMUNITY:  Rural,  migrant  community 
SCIENTIFIC  DISCIPLINE:  Physical  sciences,  engineering 

CARNEGIE  CLASSIFICATION  OF  SPONSORING  UNIVERSITY:  Research  I 
University 

NUMBER  OF  PARTICIPATING  SCIENTISTS  :  6  undergraduates  and  2  faculty 

AMOUNT  OF  TIME  SCIENTISTS  INVOLVED  IN  OUTREACH:  10  hrs/week  for 
undergraduafes  and  10/hrs  monfh  for  faculfy 

COMPENSATION  FOR  SCIENTISTS'  TIME:  Stipend 
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